Vihren Atlas

tokenization.ts ×4

Joint frontier

unlabeled · c_cc15edeea096

2 tests · 4178 LOC · 21 files · introduces 1 test · 24 LOC · 1 file

Introduces — evidence that enters the hierarchy at this concept

Code
4 ranges24 lines · 1 files
Tests
1 test

Contains — complete concept membership

All code (extent)
625 ranges4178 lines · 21 files · Browse complete extent
All tests (intent)
2 testsBrowse complete intent

Neighbourhood graph

The orange circle is the focus. Violet and green circles are every ancestor and descendant, broader and narrower, at any distance; blue squares and pink diamonds are the introduced files and exact introduced tests of every visible concept, not only the focus's. Arrows point from broader to narrower concepts and bridge only concepts omitted from this view. Undirected links show source or test introduction. Concept and file size follows LOC; exact test nodes use test-count units.

Introduced files, introduced tests, and structurally relevant concept specialization

In the embedded map, ordinary wheel input scrolls the page; use the visible controls to zoom and drag to pan. Open the full-screen map for canvas navigation: wheel pans, Ctrl/Command plus wheel zooms, and arrow keys pan when this region is focused. On touch screens, open the full-screen map to pan or pinch. If JavaScript or WebGL is unavailable, use the native relationship evidence on this page.

Introduced files, introduced tests, and structurally relevant concept specializationtokenization.ts ×3 · 6 introduced LOCtokenization.ts ×3tokenization.ts ×1 · 3 introduced LOCtokenization.ts ×1tokenization.ts ×1 · 2 introduced LOCtokenization.ts ×1tokenization.ts ×1 · 2 introduced LOCtokenization.ts ×1tokenization.ts ×8 · 40 introduced LOCtokenization.ts ×8tokenization.ts ×1 · 2 introduced LOCtokenization.ts ×1tokenization.ts ×1 · 2 introduced LOCtokenization.ts ×1tokenization.ts ×4 · 5 introduced LOCtokenization.ts ×4tokenization.ts ×14 · 59 introduced LOCtokenization.ts ×14tokenization.ts ×1 · 2 introduced LOCtokenization.ts ×1tokenization.ts ×3 · 30 introduced LOCtokenization.ts ×3tokenization.ts ×1 · 2 introduced LOCtokenization.ts ×1tokenization.ts ×2 · 2 introduced LOCtokenization.ts ×2tokenization.ts ×1 · 12 introduced LOCtokenization.ts ×1tokenization.ts ×28 · 134 introduced LOCtokenization.ts ×28color.ts ×1 · 6 introduced LOCcolor.ts ×1color.ts ×1 · 2 introduced LOCcolor.ts ×1color.ts ×2 · 25 introduced LOCcolor.ts ×2color.ts ×4 · 8 introduced LOCcolor.ts ×4color.ts ×55 · 308 introduced LOCcolor.ts ×55encodedTokenAttributes.ts ×10 · 128 introduced LOCencodedTokenAttributes.t…uri.test|title=URI URI#file, win-speciale|occurrence=1, charCode.test|title=CharCode has good values|occurrence=1, +2 · 0 introduced LOCuri.test|title=URI URI#f…utils.ts ×3 · 9 introduced LOCutils.ts ×3lifecycle.ts ×2 · 4 introduced LOClifecycle.ts ×2lifecycle.ts ×1 · 2 introduced LOClifecycle.ts ×1lifecycle.ts ×4 · 8 introduced LOClifecycle.ts ×4lifecycle.ts ×6 · 16 introduced LOClifecycle.ts ×6lifecycle.ts ×1 · 2 introduced LOClifecycle.ts ×1lifecycle.ts ×1 · 2 introduced LOClifecycle.ts ×1lifecycle.ts ×1 · 3 introduced LOClifecycle.ts ×1map.ts ×97 · 3334 introduced LOCmap.ts ×97src/vs/base/common/arrays.ts · 949 LOCcommon/arrays.tssrc/vs/base/common/arraysFind.ts · 226 LOCcommon/arraysFind.tssrc/vs/base/common/assert.ts · 91 LOCcommon/assert.tssrc/vs/base/common/charCode.ts · 450 LOCcommon/charCode.tssrc/vs/base/common/collections.ts · 176 LOCcommon/collections.tssrc/vs/base/common/color.ts · 942 LOCcommon/color.tssrc/vs/base/common/errors.ts · 357 LOCcommon/errors.tssrc/vs/base/common/functional.ts · 32 LOCcommon/functional.tssrc/vs/base/common/iterator.ts · 194 LOCcommon/iterator.tssrc/vs/base/common/lifecycle.ts · 974 LOCcommon/lifecycle.tssrc/vs/base/common/map.ts · 1016 LOCcommon/map.tssrc/vs/base/common/marshallingIds.ts · 33 LOCcommon/marshallingIds.tssrc/vs/base/common/path.ts · 1589 LOCcommon/path.tssrc/vs/base/common/platform.ts · 281 LOCcommon/platform.tssrc/vs/base/common/process.ts · 76 LOCcommon/process.tssrc/vs/base/common/types.ts · 410 LOCcommon/types.tssrc/vs/base/common/uri.ts · 754 LOCcommon/uri.tssrc/vs/base/test/common/utils.ts · 107 LOCcommon/utils.tssrc/vs/editor/common/encodedTokenAttributes.ts · 193 LOCcommon/encodedTokenAttri…src/vs/editor/common/languages/supports/tokenization.ts · 468 LOCsupports/tokenization.tssrc/vs/nls.ts · 244 LOCvs/nls.tscharCode.test|title=CharCode has good values|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/charCode.test|title=CharCode has good values|occurrence=1charCode.test|title=Char…path.test|title=Paths (Node Implementation) path|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/path.test|title=Paths (Node Implementation) path|occurrence=1path.test|title=Paths (N…uri.test|title=URI File paths containing apostrophes break URI parsing and cannot be opened #276075|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/uri.test|title=URI File paths containing apostrophes break URI parsing and cannot be opened #276075|occurrence=1uri.test|title=URI File …uri.test|title=URI URI#file, win-speciale|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/uri.test|title=URI URI#file, win-speciale|occurrence=1uri.test|title=URI URI#f…tokenization.test|title=Token theme matching can match|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/editor/test/common/modes/supports/tokenization.test|title=Token theme matching can match|occurrence=1tokenization.test|title=…tokenization.test|title=Token theme matching gives higher priority to deeper matches|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/editor/test/common/modes/supports/tokenization.test|title=Token theme matching gives higher priority to deeper matches|occurrence=1tokenization.test|title=…tokenization.test|title=Token theme resolving strcmp works|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/editor/test/common/modes/supports/tokenization.test|title=Token theme resolving strcmp works|occurrence=1tokenization.test|title=…Focused concept · tokenization.ts ×4 · 24 introduced LOCtokenization.ts ×4

Graph controls are ready.

Interactive rendering requires JavaScript and WebGL. Use the native relationship evidence on this page while the interactive map is unavailable.

Native relationship evidence

Every exact file and test below is linked only from the concept that introduces it.

Introduced tests

Every collected test enters the hierarchy at exactly one concept.

1 test introduced at this concept.

Introduced code

Every collected source range enters the hierarchy at exactly one concept.

1 file ranked by introduced lines: 24 introduced LOC across 4 ranges. Expand a file to inspect source; the > gutter marks introduced lines.

src/vs/editor/common/languages/supports/tokenization.ts 24 introduced LOC · 4 ranges

Open complete file

194
195 public static createFromRawTokenTheme(source: ITokenThemeRule[], customTokenColors: string[]): TokenTheme {
196 > return this.createFromParsedTokenTheme(parseTokenTheme(source), customTokenColors); tokenization.ts
197 > }
198
199 public static createFromParsedTokenTheme(source: ParsedTokenThemeRule[], customTokenColors: string[]): TokenTheme {
223
224 public _match(token: string): ThemeTrieElementRule {
225 > return this._root.match(token); tokenization.ts
226 > }
227
228 public match(languageId: LanguageId, token: string): number {
360
361 public match(token: string): ThemeTrieElementRule {
362 > if (token === '') { tokenization.ts
363 > return this._mainRule;
364 > }
365 >
366 > const dotIndex = token.indexOf('.');
367 > let head: string;
368 > let tail: string;
369 > if (dotIndex === -1) {
370 > head = token;
371 > tail = '';
372 > } else {
373 > head = token.substring(0, dotIndex);
374 > tail = token.substring(dotIndex + 1);
375 > }
376 >
377 > const child = this._children.get(head);
378 > if (typeof child !== 'undefined') {
379 > return child.match(tail);
380 > }
381
382 return this._mainRule;
383 > } tokenization.ts
384
385 public insert(token: string, fontStyle: FontStyle, foreground: ColorId, background: ColorId): void {

Direct hierarchy

Parents

Children