Intent of tokenization.ts ×1

All 4 exact tests in this concept. Every test is marked by where it enters the hierarchy.

mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/ 4 tests
- editor/ 4 tests
  - test/ 4 tests
    
    common/ 4 tests
    
    modes/ 4 tests
    
    supports/ 4 tests
    
    mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/editor/test/common/modes/supports/tokenization.test|title=Token theme matching can match|occurrence=1 Inherited tokenization.ts ×3
    
    mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/editor/test/common/modes/supports/tokenization.test|title=Token theme matching gives higher priority to deeper matches|occurrence=1 Inherited tokenization.ts ×4
    
    mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/editor/test/common/modes/supports/tokenization.test|title=Token theme resolving rules are inherited 2|occurrence=1 Inherited tokenization.test|title=Token theme resolving rules are inherited 2|occurrence=1
    
    mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/editor/test/common/modes/supports/tokenization.test|title=Token theme resolving strcmp works|occurrence=1 Introduced here