Default package

Get desktop application:
View/edit binary Protocol Buffers messages

• UNKNOWN_LANG = 0

• JAVA = 3

Types of tokens produced by a tokenizer.

• EOI = 0

  EOI marks an end-of-input.

• ERROR_TOKEN = 1

  ERROR_TOKEN is produced for unrecognized parts of the input.

• KEYWORD = 2

  Common classes of tokens.

• STRING_LITERAL = 3

• COMMENT = 4

• IDENTIFIER = 5

• NUMERIC_LITERAL = 6

• MACRO = 7

  Various language-specific extensions.

  For C++

• CLASS_NAME = 8

  For Java

• CONST_NAME = 9

  For Java

• JAVADOC = 10

  For JavaDoc-like comments (Java and JavaScript).

• JAVADOC_TAG = 11

• TASK_TAG = 12

  For TODOs in comments

• ESCAPE_SEQUENCE = 13

• PUNCTUATION = 22