tokenizerSyntaxTokenBackend.ts ×2
Frontier kind: Code frontier
unlabeled · c_d0a649c05cbc
77 tests · 40530 LOC · 238 files · introduces 0 tests · 12 LOC · 3 files
Introduces — evidence that enters the hierarchy at this concept
Code
6 ranges 12 lines · 3 files
Tests
0 tests
Contains — complete concept membership
Neighbourhood graph
The orange circle is the focus. Violet and green circles are every ancestor and descendant, broader and narrower, at any distance; blue squares and pink diamonds are the introduced files and exact introduced tests of every visible concept, not only the focus's. Arrows point from broader to narrower concepts and bridge only concepts omitted from this view. Undirected links show source or test introduction. Concept and file size follows LOC; exact test nodes use test-count units.
Introduced files, introduced tests, and structurally relevant concept specialization
In the embedded map, ordinary wheel input scrolls the page; use the visible controls to zoom and drag to pan. Open the full-screen map for canvas navigation: wheel pans, Ctrl/Command plus wheel zooms, and arrow keys pan when this region is focused. On touch screens, open the full-screen map to pan or pinch. If JavaScript or WebGL is unavailable, use the native relationship evidence on this page.
Graph controls are ready.
Interactive rendering requires JavaScript and WebGL. Use the native relationship evidence on this page while the interactive map is unavailable.
JavaScript is disabled; use the native relationship evidence on this page to explore the same evidence.
Native relationship evidence
Every exact file and test below is linked only from the concept that introduces it.
tokenizerSyntaxTokenBackend.ts ×2 Introduced files:
JavaScript Issue #25437|occurrence=1, JavaScript Issue #141816|occurrence=1 Introduced tests:
indentation.ts ×1 Introduced files:
Introduced tests:
textModelTokens.ts ×4 Introduced files:
JavaScript Enriching the hover|occurrence=1 Introduced tests:
JavaScript Issue #86176|occurrence=1 Introduced tests:
indentation.ts ×4 Introduced files:
Introduced tests:
indentation.ts ×1 Introduced files:
indentation.ts ×6 Introduced files:
languageConfigurationExtensionPoint.ts ×38 Introduced files:
model.line.test|title=ModelLinesTokens updates tokens on replace 2|occurrence=1 Introduced tests:
model.modes.test|title=Editor Model - Model Modes 1 model invalidates states for one line delete|occurrence=1 Introduced tests:
model.modes.test|title=Editor Model - Model Modes 1 model invalidates states for one new line|occurrence=1 Introduced tests:
model.modes.test|title=Editor Model - Model Modes 2 getTokensForInvalidLines two text insert|occurrence=1 Introduced tests:
model.modes.test|title=Editor Model - Model Modes 2 getTokensForInvalidLines one multi-line text insert, one small text insert|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens multi insert 9|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens multi insert 8|occurrence=1, model.line.test|title=ModelLinesTokens split inthe middle 2|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens split inthe middle 1|occurrence=1 Introduced tests:
tokenizer.ts ×1 Introduced files:
Introduced tests:
model.modes.test|title=Editor Model - Model Modes 2 getTokensForInvalidLines one text insert|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens single insert 3|occurrence=1, model.line.test|title=ModelLinesTokens updates tokens on insertion 4|occurrence=1, +1 Introduced tests:
model.line.test|title=ModelLinesTokens single insert 4|occurrence=1, model.line.test|title=ModelLinesTokens updates tokens on insertion 5|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens single insert 2|occurrence=1, model.line.test|title=ModelLinesTokens updates tokens on insertion 2|occurrence=1, +1 Introduced tests:
model.line.test|title=ModelLinesTokens updates tokens on replace 1|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens multi insert 7|occurrence=1, model.line.test|title=ModelLinesTokens split at the end|occurrence=1 Introduced tests:
contiguousTokensEditing.ts ×1 Introduced files:
model.line.test|title=ModelLinesTokens multi delete 6|occurrence=1 Introduced tests:
contiguousTokensStore.ts ×1 Introduced files:
Introduced tests:
model.modes.test|title=Editor Model - Model Modes 1 model invalidates states for one line insert|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens multi insert 6|occurrence=1, model.line.test|title=ModelLinesTokens split at the beginning|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens single insert 5|occurrence=1, model.line.test|title=ModelLinesTokens updates tokens on insertion 6|occurrence=1, +1 Introduced tests:
model.line.test|title=ModelLinesTokens append 1|occurrence=1, model.line.test|title=ModelLinesTokens append 2|occurrence=1, +1 Introduced tests:
model.line.test|title=ModelLinesTokens multi delete 9|occurrence=1 Introduced tests:
fixedArray.ts ×1 Introduced files:
model.line.test|title=ModelLinesTokens single insert 1|occurrence=1, model.line.test|title=ModelLinesTokens updates tokens on insertion 1|occurrence=1, +1 Introduced tests:
contiguousTokensEditing.ts ×3 Introduced files:
model.modes.test|title=Editor Model - Model Modes 2 getTokensForInvalidLines multiple lines delete text|occurrence=1 Introduced tests:
contiguousTokensEditing.ts ×1 Introduced files:
Introduced tests:
model.line.test|title=ModelLinesTokens multi delete 7|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens delete second token|occurrence=1, model.line.test|title=ModelLinesTokens delete second token 2|occurrence=1, +1 Introduced tests:
model.line.test|title=ModelLinesTokens single delete 2|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens single delete 4|occurrence=1 Introduced tests:
contiguousTokensEditing.ts ×2 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
model.line.test|title=ModelLinesTokens insertion on empty line|occurrence=1 Introduced tests:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
model.modes.test|title=Editor Model - Model Modes 2 getTokensForInvalidLines one delete text|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens delete 2nd and 3rd chars|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens single delete 3|occurrence=1, model.line.test|title=ModelLinesTokens delete first token|occurrence=1 Introduced tests:
model.modes.test|title=Editor Model - Model Modes 1 model invalidates states for many lines delete|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens delete second and third token|occurrence=1, model.line.test|title=ModelLinesTokens equivalent to deleting from 5 to the end|occurrence=1 Introduced tests:
model.modes.test|title=Editor Model - Model Modes 2 getTokensForInvalidLines one line delete text|occurrence=1 Introduced tests:
contiguousTokensEditing.ts ×1 Introduced files:
Introduced tests:
model.line.test|title=ModelLinesTokens multi delete 8|occurrence=1 Introduced tests:
fixedArray.ts ×3 Introduced files:
model.line.test|title=ModelLinesTokens single delete 1|occurrence=1, model.line.test|title=ModelLinesTokens delete first char|occurrence=1, +1 Introduced tests:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensEditing.ts ×2 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
smallImmutableSet.ts ×2 Introduced files:
Introduced tests:
contiguousTokensEditing.ts ×4 Introduced files:
model.line.test|title=ModelLinesTokens single delete 5|occurrence=1, model.line.test|title=ModelLinesTokens delete everything|occurrence=1 Introduced tests:
fixedArray.ts ×1 Introduced files:
contiguousTokensStore.ts ×2 Introduced files:
fixedArray.ts ×3 Introduced files:
nullTokenize.ts ×1 Introduced files:
model.line.test|title=ModelLinesTokens updates tokens on insertion 10|occurrence=1 Introduced tests:
fixedArray.ts ×2 Introduced files:
textModelWithTokens.test|title=TextModelWithTokens 2 issue #88075: TypeScript brace matching is incorrect in `${}` strings|occurrence=1 Introduced tests:
bracketPairsTree.ts ×2 Introduced files:
tokenizer.ts ×4 Introduced files:
contiguousTokensStore.ts ×3 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensEditing.ts ×2 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensEditing.ts ×4 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensStore.ts ×2 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
fixedArray.ts ×1 Introduced files:
contiguousTokensStore.ts ×2 Introduced files:
textModel.ts ×3 Introduced files:
Introduced tests:
contiguousTokensStore.ts ×1 Introduced files:
contiguousTokensStore.ts ×1 Introduced files:
contiguousTokensStore.ts ×1 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensEditing.ts ×2 Introduced files:
contiguousTokensStore.ts ×1 Introduced files:
contiguousTokensEditing.ts ×2 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensEditing.ts ×4 Introduced files:
model.line.test|title=ModelLinesTokens updates tokens on insertion 9|occurrence=1 Introduced tests:
model.line.test|title=ModelLinesTokens noop|occurrence=1 Introduced tests:
textModel.ts ×1 Introduced files:
Introduced tests:
contiguousTokensStore.ts ×1 Introduced files:
textModelTokens.ts ×3 Introduced files:
abstractSyntaxTokenBackend.ts ×3 Introduced files:
model.modes.test|title=Editor Model - Model Modes 1 model caches states|occurrence=1 Introduced tests:
tokenizerSyntaxTokenBackend.ts ×2 Introduced files:
model.modes.test|title=Editor Model - Model Modes 1 model calls syntax highlighter 2|occurrence=1 Introduced tests:
tokenizerSyntaxTokenBackend.ts ×1 Introduced files:
model.modes.test|title=Editor Model - Model Modes 1 model calls syntax highlighter 1|occurrence=1 Introduced tests:
contiguousTokensStore.ts ×1 Introduced files:
contiguousTokensStore.ts ×2 Introduced files:
textModelTokens.ts ×5 Introduced files:
textModelTokens.ts ×4 Introduced files:
nullTokenize.ts ×1 Introduced files:
textModelTokens.ts ×24 Introduced files:
contiguousTokensStore.ts ×1 Introduced files:
contiguousTokensStore.ts ×2 Introduced files:
contiguousTokensEditing.ts ×1 Introduced files:
contiguousTokensStore.ts ×1 Introduced files:
contiguousTokensStore.ts ×1 Introduced files:
contiguousTokensStore.ts ×1 Introduced files:
contiguousTokensStore.ts ×11 Introduced files:
tokenizationTextModelPart.ts ×1 Introduced files:
tokenizationTextModelPart.ts ×2 Introduced files:
textModel.ts ×2 Introduced files:
pieceTreeTextBuffer.ts ×1 Introduced files:
textModel.ts ×1 Introduced files:
model.ts ×1 Introduced files:
testTextModel.ts ×2 Introduced files:
textModel.ts ×1 Introduced files:
textModel.ts ×1 Introduced files:
textModel.ts ×20 Introduced files:
languagesRegistry.ts ×1 Introduced files:
tokenizationRegistry.ts ×1 Introduced files:
instantiationServiceMock.ts ×1 Introduced files:
pieceTreeBase.ts ×4 Introduced files:
pieceTreeBase.ts ×6 Introduced files:
textModel.ts ×2 Introduced files:
pieceTreeBase.ts ×1 Introduced files:
pieceTreeBase.ts ×1 Introduced files:
instantiationServiceMock.ts ×2 Introduced files:
sparseTokensStore.ts ×1 Introduced files:
testThemeService.ts ×18 Introduced files:
modelService.ts ×30 Introduced files:
pieceTreeTextBuffer.ts ×2 Introduced files:
pieceTreeBase.ts ×1 Introduced files:
pieceTreeBase.ts ×2 Introduced files:
rbTreeBase.ts ×6 Introduced files:
textModel.ts ×1 Introduced files:
pieceTreeBase.ts ×2 Introduced files:
pieceTreeTextBufferBuilder.ts ×1 Introduced files:
pieceTreeBase.ts ×1 Introduced files:
pieceTreeTextBufferBuilder.ts ×1 Introduced files:
pieceTreeTextBufferBuilder.ts ×19 Introduced files:
textModel.ts ×190 Introduced files:
derived.ts ×1 Introduced files:
languagesRegistry.ts ×4 Introduced files:
testTextResourcePropertiesService.ts ×3 Introduced files:
languageService.ts ×24 Introduced files:
testLanguageConfigurationService.ts ×1 Introduced files:
languageConfigurationRegistry.ts ×5 Introduced files:
testLanguageConfigurationService.ts ×4 Introduced files:
languageConfigurationRegistry.ts ×28 Introduced files:
lifecycle.ts ×1 Introduced files:
event.ts ×3 Introduced files:
languagesRegistry.ts ×1 Introduced files:
languagesRegistry.ts ×2 Introduced files:
languagesRegistry.ts ×1 Introduced files:
languagesRegistry.ts ×2 Introduced files:
log.ts ×72 Introduced files:
languagesRegistry.ts ×26 Introduced files:
onEnter.ts ×6 Introduced files:
strings.ts ×1 Introduced files:
editorOptions.ts ×92 Introduced files:
observableValue.ts ×1 Introduced files:
instantiationService.test|title=Instantiation Service SyncDesc - target depends on service future|occurrence=1 Introduced tests:
graph.ts ×1 Introduced files:
instantiationService.ts ×1 Introduced files:
instantiationService.ts ×8 Introduced files:
instantiationServiceMock.ts ×3 Introduced files:
instantiationService.test|title=Instantiation Service @Param - fixed args|occurrence=1, instantiationService.test|title=Instantiation Service @Param - simple clase|occurrence=1 Introduced tests:
electricCharacter.ts ×4 Introduced files:
buffer.test|title=Buffer Performance issue with VSBuffer#slice #76076|occurrence=1 Introduced tests:
instantiationServiceMock.ts ×2 Introduced files:
instantiationServiceMock.ts ×2 Introduced files:
instantiationService.ts ×2 Introduced files:
serviceCollection.ts ×1 Introduced files:
Introduced tests:
instantiationService.test|title=Instantiation Service service collection, cannot overwrite|occurrence=1 Introduced tests:
instantiationService.ts ×1 Introduced files:
instantiationService.ts ×6 Introduced files:
instantiationService.ts ×2 Introduced files:
instantiationService.ts ×3 Introduced files:
serviceCollection.ts ×1 Introduced files:
instantiationService.ts ×1 Introduced files:
serviceCollection.ts ×3 Introduced files:
annotations.ts ×1 Introduced files:
annotations.ts ×15 Introduced files:
languageSelector.ts ×3 Introduced files:
utils.ts ×1 Introduced files:
derivedImpl.ts ×2 Introduced files:
utils.ts ×4 Introduced files:
ast.ts ×2 Introduced files:
ast.ts ×1 Introduced files:
ast.ts ×76 Introduced files:
lifecycle.ts ×1 Introduced files:
contextkey.ts ×1 Introduced files:
async.ts ×202 Introduced files:
contextkey.ts ×1 Introduced files:
contextkey.ts ×1 Introduced files:
contextkey.ts ×1 Introduced files:
contextkey.ts ×1 Introduced files:
derivedImpl.ts ×2 Introduced files:
contextkey.ts ×2 Introduced files:
contextkey.ts ×1 Introduced files:
contextkey.ts ×201 Introduced files:
derivedImpl.ts ×1 Introduced files:
observableSignal.ts ×4 Introduced files:
derived.ts ×1 Introduced files:
baseObservable.ts ×1 Introduced files:
observableValue.ts ×3 Introduced files:
baseObservable.ts ×1 Introduced files:
derived.ts ×1 Introduced files:
observableValue.ts ×1 Introduced files:
testDialogService.ts ×1 Introduced files:
derivedImpl.ts ×1 Introduced files:
undoRedoService.ts ×1 Introduced files:
debugGetDependencyGraph.ts ×2 Introduced files:
observableSignalFromEvent.ts ×1 Introduced files:
promise.ts ×1 Introduced files:
undoRedoService.ts ×83 Introduced files:
characterPair.ts ×5 Introduced files:
length.ts ×22 Introduced files:
textLength.ts ×21 Introduced files:
lifecycle.ts ×1 Introduced files:
language.ts ×1 Introduced files:
hash.ts ×17 Introduced files:
mock.ts ×1 Introduced files:
lifecycle.ts ×1 Introduced files:
lifecycle.ts ×3 Introduced files:
resources.ts ×23 Introduced files:
wordHelper.ts ×5 Introduced files:
cursorColumns.ts ×9 Introduced files:
extensions.ts ×1 Introduced files:
strings.test|title=Strings trimWhitespace|occurrence=1 Introduced tests:
instantiation.ts ×1 Introduced files:
strings.ts ×101 Introduced files:
event.ts ×1 Introduced files:
event.ts ×2 Introduced files:
event.ts ×1 Introduced files:
event.ts ×5 Introduced files:
lineRange.ts ×40 Introduced files:
lifecycle.ts ×4 Introduced files:
cancellation.test|title=CancellationToken None|occurrence=1 Introduced tests:
event.ts ×1 Introduced files:
event.ts ×1 Introduced files:
event.ts ×3 Introduced files:
lifecycle.test|title=No Leakage Utilities ensureNoDisposablesAreLeakedInTest Basic Test|occurrence=1 Introduced tests:
event.ts ×8 Introduced files:
event.ts ×3 Introduced files:
cancellation.ts ×18 Introduced files:
lifecycle.ts ×2 Introduced files:
lifecycle.ts ×1 Introduced files:
lifecycle.test|title=Lifecycle dispose disposable array|occurrence=1, lifecycle.test|title=Lifecycle Action bar has broken accessibility #100273|occurrence=1 Introduced tests:
event.ts ×1 Introduced files:
lifecycle.ts ×3 Introduced files:
event.ts ×4 Introduced files:
event.ts ×2 Introduced files:
lifecycle.ts ×2 Introduced files:
event.ts ×2 Introduced files:
event.ts ×93 Introduced files:
intervalTree.ts ×1 Introduced files:
intervalTree.ts ×44 Introduced files:
range.test|title=Editor Core - Range no swap|occurrence=1, range.test|title=Editor Core - Range empty range|occurrence=1, +1 Introduced tests:
range.ts ×1 Introduced files:
range.ts ×1 Introduced files:
buffer.ts ×42 Introduced files:
lifecycle.ts ×1 Introduced files:
uri.ts ×1 Introduced files:
smallImmutableSet.ts ×14 Introduced files:
configuration.ts ×12 Introduced files:
numbers.ts ×13 Introduced files:
languageStatusDedupe.test|title=LanguageStatus - Dedicated Entry Deduplication disposes entries no longer in model|occurrence=1 Introduced tests:
languageStatusDedupe.test|title=LanguageStatus - Dedicated Entry Deduplication mixed unique and duplicate IDs|occurrence=1, languageStatusDedupe.test|title=LanguageStatus - Dedicated Entry Deduplication creates new entry when none exists|occurrence=1, +4 Introduced tests:
uuid.test|title=UUID generation|occurrence=1 Introduced tests:
uri.ts ×3 Introduced files:
types.test|title=Types isString|occurrence=1 Introduced tests:
types.test|title=Types isUndefined|occurrence=1 Introduced tests:
uri.test|title=URI URI#file, win-speciale|occurrence=1, charCode.test|title=CharCode has good values|occurrence=1, +2 Introduced tests:
uri.ts ×3 Introduced files:
uri.ts ×2 Introduced files:
utils.ts ×3 Introduced files:
uri.ts ×1 Introduced files:
instantiation.ts ×4 Introduced files:
uri.ts ×9 Introduced files:
telemetry.ts ×3 Introduced files:
nls.ts ×1 Introduced files:
errorMessage.ts ×6 Introduced files:
lifecycle.ts ×1 Introduced files:
objects.ts ×13 Introduced files:
instantiation.ts ×5 Introduced files:
lifecycle.ts ×1 Introduced files:
lifecycle.ts ×2 Introduced files:
lifecycle.ts ×2 Introduced files:
lifecycle.ts ×1 Introduced files:
lifecycle.ts ×1 Introduced files:
lifecycle.ts ×1 Introduced files:
lifecycle.ts ×3 Introduced files:
lifecycle.ts ×1 Introduced files:
lifecycle.ts ×1 Introduced files:
lifecycle.ts ×4 Introduced files:
types.ts ×1 Introduced files:
types.ts ×1 Introduced files:
lifecycle.ts ×4 Introduced files:
lifecycle.ts ×6 Introduced files:
lifecycle.ts ×2 Introduced files:
lazy.ts ×1 Introduced files:
lifecycle.ts ×1 Introduced files:
uuid.ts ×3 Introduced files:
lifecycle.ts ×1 Introduced files:
lifecycle.ts ×1 Introduced files:
uint.ts ×2 Introduced files:
lifecycle.ts ×1 Introduced files:
map.ts ×97 Introduced files:
Introduced tests
Every collected test enters the hierarchy at exactly one concept.
No tests are introduced at this concept. Its intent tests are introduced by other concepts.
Introduced code
Every collected source range enters the hierarchy at exactly one concept.
3 files ranked by introduced lines: 12 introduced LOC across 6 ranges.
Expand a file to inspect source; the > gutter marks introduced lines.
src/vs/editor/common/model/tokens/tokenizerSyntaxTokenBackend.ts 6 introduced LOC · 2 ranges
Open complete file
208
209
private setTokens ( tokens : ContiguousMultilineTokens []) : { changes : { fromLineNumber : number ; toLineNumber : number }[] } {
211
>
212
>
if ( changes . length > 0 ) {
213
this . _onDidChangeTokens . fire ({ semanticTokensApplied : false , ranges : changes , });
214
}
216
>
return { changes : changes };
217
>
}
218
219
private setFontInfo ( changes : FontTokensUpdate ) : void {
src/vs/editor/common/tokens/contiguousMultilineTokensBuilder.ts 4 introduced LOC · 2 ranges
Open complete file
22
23
constructor () {
25
>
}
26
27
public add ( lineNumber : number , lineTokens : Uint32Array ) : void {
38
39
public finalize () : ContiguousMultilineTokens [] {
41
>
}
42
43
public serialize () : Uint8Array {
src/vs/editor/common/tokens/contiguousTokensStore.ts 2 introduced LOC · 2 ranges
Open complete file
212
213
public setMultilineTokens ( tokens : ContiguousMultilineTokens [], textModel : ITextModel ) : { changes : { fromLineNumber : number ; toLineNumber : number }[] } {
215
return { changes : [] };
216
}
242
243
return { changes : ranges };
245
}
246