Vihren Atlas

lineTokens.ts ×3

Joint frontier

unlabeled · c_8424665d8768

4 tests · 9363 LOC · 46 files · introduces 1 test · 33 LOC · 1 file

Introduces — evidence that enters the hierarchy at this concept

Code
3 ranges33 lines · 1 files
Tests
1 test

Contains — complete concept membership

All code (extent)
1326 ranges9363 lines · 46 files · Browse complete extent
All tests (intent)
4 testsBrowse complete intent

Neighbourhood graph

The orange circle is the focus. Violet and green circles are every ancestor and descendant, broader and narrower, at any distance; blue squares and pink diamonds are the introduced files and exact introduced tests of every visible concept, not only the focus's. Arrows point from broader to narrower concepts and bridge only concepts omitted from this view. Undirected links show source or test introduction. Concept and file size follows LOC; exact test nodes use test-count units.

Introduced files, introduced tests, and structurally relevant concept specialization

In the embedded map, ordinary wheel input scrolls the page; use the visible controls to zoom and drag to pan. Open the full-screen map for canvas navigation: wheel pans, Ctrl/Command plus wheel zooms, and arrow keys pan when this region is focused. On touch screens, open the full-screen map to pan or pinch. If JavaScript or WebGL is unavailable, use the native relationship evidence on this page.

Introduced files, introduced tests, and structurally relevant concept specializationtokensStore.test|title=TokensStore addSparseTokens skips overlapping semantic tokens that produce backward endOffsets|occurrence=1 · 0 introduced LOCtokensStore.test|title=T…lineTokens.ts ×1 · 6 introduced LOClineTokens.ts ×1lineTokens.ts ×1 · 3 introduced LOClineTokens.ts ×1lineTokens.ts ×1 · 2 introduced LOClineTokens.ts ×1lineTokens.ts ×1 · 2 introduced LOClineTokens.ts ×1lineTokens.ts ×1 · 2 introduced LOClineTokens.ts ×1lineTokens.ts ×2 · 7 introduced LOClineTokens.ts ×2languagesRegistry.ts ×2 · 7 introduced LOClanguagesRegistry.ts ×2languagesRegistry.ts ×26 · 103 introduced LOClanguagesRegistry.ts ×26languagesAssociations.ts ×11 · 77 introduced LOClanguagesAssociations.ts…lineTokens.ts ×55 · 214 introduced LOClineTokens.ts ×55glob.ts ×24 · 167 introduced LOCglob.ts ×24async.ts ×202 · 1247 introduced LOCasync.ts ×202modesRegistry.ts ×3 · 77 introduced LOCmodesRegistry.ts ×3resources.ts ×23 · 253 introduced LOCresources.ts ×23configurationRegistry.ts ×2 · 9 introduced LOCconfigurationRegistry.ts…configurationRegistry.ts ×9 · 65 introduced LOCconfigurationRegistry.ts…network.ts ×20 · 292 introduced LOCnetwork.ts ×20strings.test|title=Strings trimWhitespace|occurrence=1 · 0 introduced LOCstrings.test|title=Strin…extpath.ts ×17 · 91 introduced LOCextpath.ts ×17configurationRegistry.ts ×1 · 3 introduced LOCconfigurationRegistry.ts…configurationRegistry.ts ×6 · 32 introduced LOCconfigurationRegistry.ts…configurationRegistry.ts ×1 · 13 introduced LOCconfigurationRegistry.ts…strings.ts ×101 · 542 introduced LOCstrings.ts ×101configurationRegistry.ts ×2 · 2 introduced LOCconfigurationRegistry.ts…configurationRegistry.ts ×5 · 10 introduced LOCconfigurationRegistry.ts…configurationRegistry.ts ×40 · 487 introduced LOCconfigurationRegistry.ts…jsonContributionRegistry.ts ×9 · 100 introduced LOCjsonContributionRegistry…cancellation.test|title=CancellationToken None|occurrence=1 · 0 introduced LOCcancellation.test|title=…cancellation.ts ×18 · 90 introduced LOCcancellation.ts ×18lifecycle.ts ×2 · 3 introduced LOClifecycle.ts ×2event.ts ×1 · 1 introduced LOCevent.ts ×1event.ts ×4 · 9 introduced LOCevent.ts ×4event.ts ×2 · 4 introduced LOCevent.ts ×2event.ts ×2 · 6 introduced LOCevent.ts ×2event.ts ×93 · 864 introduced LOCevent.ts ×93offsetRange.ts ×40 · 132 introduced LOCoffsetRange.ts ×40configuration.ts ×12 · 203 introduced LOCconfiguration.ts ×12encodedTokenAttributes.ts ×10 · 128 introduced LOCencodedTokenAttributes.t…mime.ts ×5 · 102 introduced LOCmime.ts ×5arrays.ts ×2 · 4 introduced LOCarrays.ts ×2map.ts ×1 · 2 introduced LOCmap.ts ×1platform.ts ×1 · 2 introduced LOCplatform.ts ×1arrays.ts ×2 · 5 introduced LOCarrays.ts ×2map.ts ×1 · 4 introduced LOCmap.ts ×1platform.ts ×1 · 6 introduced LOCplatform.ts ×1types.test|title=Types isString|occurrence=1 · 0 introduced LOCtypes.test|title=Types i…types.test|title=Types isUndefined|occurrence=1 · 0 introduced LOCtypes.test|title=Types i…map.ts ×1 · 6 introduced LOCmap.ts ×1uri.test|title=URI URI#file, win-speciale|occurrence=1, charCode.test|title=CharCode has good values|occurrence=1, +2 · 0 introduced LOCuri.test|title=URI URI#f…product.ts ×4 · 39 introduced LOCproduct.ts ×4utils.ts ×3 · 9 introduced LOCutils.ts ×3nls.ts ×1 · 1 introduced LOCnls.ts ×1nls.ts ×3 · 9 introduced LOCnls.ts ×3nls.ts ×1 · 1 introduced LOCnls.ts ×1linkedList.ts ×13 · 44 introduced LOClinkedList.ts ×13nls.ts ×6 · 13 introduced LOCnls.ts ×6instantiation.ts ×5 · 111 introduced LOCinstantiation.ts ×5platform.ts ×5 · 46 introduced LOCplatform.ts ×5types.ts ×1 · 2 introduced LOCtypes.ts ×1jsonSchema.ts ×3 · 194 introduced LOCjsonSchema.ts ×3lifecycle.ts ×2 · 4 introduced LOClifecycle.ts ×2types.ts ×1 · 2 introduced LOCtypes.ts ×1assert.ts ×2 · 2 introduced LOCassert.ts ×2lifecycle.ts ×1 · 3 introduced LOClifecycle.ts ×1lifecycle.ts ×3 · 9 introduced LOClifecycle.ts ×3types.ts ×2 · 5 introduced LOCtypes.ts ×2lifecycle.ts ×1 · 2 introduced LOClifecycle.ts ×1types.ts ×1 · 2 introduced LOCtypes.ts ×1types.ts ×1 · 2 introduced LOCtypes.ts ×1lifecycle.ts ×4 · 8 introduced LOClifecycle.ts ×4lifecycle.ts ×6 · 16 introduced LOClifecycle.ts ×6lifecycle.ts ×2 · 2 introduced LOClifecycle.ts ×2lazy.ts ×1 · 2 introduced LOClazy.ts ×1lifecycle.ts ×1 · 3 introduced LOClifecycle.ts ×1lazy.ts ×3 · 37 introduced LOClazy.ts ×3lifecycle.ts ×1 · 2 introduced LOClifecycle.ts ×1lifecycle.ts ×1 · 2 introduced LOClifecycle.ts ×1uint.ts ×2 · 43 introduced LOCuint.ts ×2lifecycle.ts ×1 · 3 introduced LOClifecycle.ts ×1map.ts ×97 · 3334 introduced LOCmap.ts ×97src/vs/base/common/arrays.ts · 949 LOCcommon/arrays.tssrc/vs/base/common/arraysFind.ts · 226 LOCcommon/arraysFind.tssrc/vs/base/common/assert.ts · 91 LOCcommon/assert.tssrc/vs/base/common/async.ts · 2749 LOCcommon/async.tssrc/vs/base/common/cache.ts · 153 LOCcommon/cache.tssrc/vs/base/common/cancellation.ts · 206 LOCcommon/cancellation.tssrc/vs/base/common/charCode.ts · 450 LOCcommon/charCode.tssrc/vs/base/common/collections.ts · 176 LOCcommon/collections.tssrc/vs/base/common/errors.ts · 357 LOCcommon/errors.tssrc/vs/base/common/event.ts · 1964 LOCcommon/event.tssrc/vs/base/common/extpath.ts · 433 LOCcommon/extpath.tssrc/vs/base/common/functional.ts · 32 LOCcommon/functional.tssrc/vs/base/common/glob.ts · 861 LOCcommon/glob.tssrc/vs/base/common/iterator.ts · 194 LOCcommon/iterator.tssrc/vs/base/common/jsonSchema.ts · 330 LOCcommon/jsonSchema.tssrc/vs/base/common/lazy.ts · 57 LOCcommon/lazy.tssrc/vs/base/common/lifecycle.ts · 974 LOCcommon/lifecycle.tssrc/vs/base/common/linkedList.ts · 151 LOCcommon/linkedList.tssrc/vs/base/common/map.ts · 1016 LOCcommon/map.tssrc/vs/base/common/marshallingIds.ts · 33 LOCcommon/marshallingIds.tssrc/vs/base/common/mime.ts · 136 LOCcommon/mime.tssrc/vs/base/common/network.ts · 440 LOCcommon/network.tssrc/vs/base/common/path.ts · 1589 LOCcommon/path.tssrc/vs/base/common/platform.ts · 281 LOCcommon/platform.tssrc/vs/base/common/process.ts · 76 LOCcommon/process.tssrc/vs/base/common/resources.ts · 444 LOCcommon/resources.tssrc/vs/base/common/stopwatch.ts · 41 LOCcommon/stopwatch.tssrc/vs/base/common/strings.ts · 1413 LOCcommon/strings.tssrc/vs/base/common/symbols.ts · 9 LOCcommon/symbols.tssrc/vs/base/common/types.ts · 410 LOCcommon/types.tssrc/vs/base/common/uint.ts · 59 LOCcommon/uint.tssrc/vs/base/common/uri.ts · 754 LOCcommon/uri.tssrc/vs/base/test/common/utils.ts · 107 LOCcommon/utils.tssrc/vs/editor/common/core/ranges/offsetRange.ts · 290 LOCranges/offsetRange.tssrc/vs/editor/common/encodedTokenAttributes.ts · 193 LOCcommon/encodedTokenAttri…src/vs/editor/common/languages/modesRegistry.ts · 86 LOClanguages/modesRegistry.…src/vs/editor/common/services/languagesAssociations.ts · 268 LOCservices/languagesAssoci…src/vs/editor/common/services/languagesRegistry.ts · 367 LOCservices/languagesRegist…src/vs/editor/common/tokens/lineTokens.ts · 527 LOCtokens/lineTokens.tssrc/vs/nls.ts · 244 LOCvs/nls.tssrc/vs/platform/configuration/common/configuration.ts · 358 LOCcommon/configuration.tssrc/vs/platform/configuration/common/configurationRegistry.ts · 1089 LOCcommon/configurationRegi…src/vs/platform/instantiation/common/instantiation.ts · 130 LOCcommon/instantiation.tssrc/vs/platform/jsonschemas/common/jsonContributionRegistry.ts · 143 LOCcommon/jsonContributionR…src/vs/platform/product/common/product.ts · 93 LOCcommon/product.tssrc/vs/platform/registry/common/platform.ts · 63 LOCcommon/platform.tscancellation.test|title=CancellationToken None|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/cancellation.test|title=CancellationToken None|occurrence=1cancellation.test|title=…charCode.test|title=CharCode has good values|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/charCode.test|title=CharCode has good values|occurrence=1charCode.test|title=Char…path.test|title=Paths (Node Implementation) path|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/path.test|title=Paths (Node Implementation) path|occurrence=1path.test|title=Paths (N…strings.test|title=Strings trimWhitespace|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/strings.test|title=Strings trimWhitespace|occurrence=1strings.test|title=Strin…types.test|title=Types isString|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/types.test|title=Types isString|occurrence=1types.test|title=Types i…types.test|title=Types isUndefined|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/types.test|title=Types isUndefined|occurrence=1types.test|title=Types i…uri.test|title=URI File paths containing apostrophes break URI parsing and cannot be opened #276075|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/uri.test|title=URI File paths containing apostrophes break URI parsing and cannot be opened #276075|occurrence=1uri.test|title=URI File …uri.test|title=URI URI#file, win-speciale|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/base/test/common/uri.test|title=URI URI#file, win-speciale|occurrence=1uri.test|title=URI URI#f…lineTokens.test|title=LineTokens withInserted (tokens at the end)|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/editor/test/common/core/lineTokens.test|title=LineTokens withInserted (tokens at the end)|occurrence=1lineTokens.test|title=Li…lineTokens.test|title=LineTokens withInserted (tokens at the same position)|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/editor/test/common/core/lineTokens.test|title=LineTokens withInserted (tokens at the same position)|occurrence=1lineTokens.test|title=Li…lineTokens.test|title=LineTokens withInserted 1|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/editor/test/common/core/lineTokens.test|title=LineTokens withInserted 1|occurrence=1lineTokens.test|title=Li…tokensStore.test|title=TokensStore addSparseTokens skips overlapping semantic tokens that produce backward endOffsets|occurrence=1 · introduced test · mocha:v1|namespace=vscode@05c208e9e28d8c1c723fa08f85e2b7a96092e8e5|file=vs/editor/test/common/model/tokensStore.test|title=TokensStore addSparseTokens skips overlapping semantic tokens that produce backward endOffsets|occurrence=1tokensStore.test|title=T…Focused concept · lineTokens.ts ×3 · 33 introduced LOClineTokens.ts ×3

Graph controls are ready.

Interactive rendering requires JavaScript and WebGL. Use the native relationship evidence on this page while the interactive map is unavailable.

Native relationship evidence

Every exact file and test below is linked only from the concept that introduces it.

Introduced tests

Every collected test enters the hierarchy at exactly one concept.

1 test introduced at this concept.

Introduced code

Every collected source range enters the hierarchy at exactly one concept.

1 file ranked by introduced lines: 33 introduced LOC across 3 ranges. Expand a file to inspect source; the > gutter marks introduced lines.

src/vs/editor/common/tokens/lineTokens.ts 33 introduced LOC · 3 ranges

Open complete file

221 */
222 public withInserted(insertTokens: { offset: number; text: string; tokenMetadata: number }[]): LineTokens {
223 > if (insertTokens.length === 0) { lineTokens.ts
224 return this;
225 }
226 > lineTokens.ts
227 > let nextOriginalTokenIdx = 0;
228 > let nextInsertTokenIdx = 0;
229 > let text = '';
230 > const newTokens = new Array<number>();
231 >
232 > let originalEndOffset = 0;
233 > while (true) {
234 > const nextOriginalTokenEndOffset = nextOriginalTokenIdx < this._tokensCount ? this._tokens[nextOriginalTokenIdx << 1] : -1;
235 > const nextInsertToken = nextInsertTokenIdx < insertTokens.length ? insertTokens[nextInsertTokenIdx] : null;
236 >
237 > if (nextOriginalTokenEndOffset !== -1 && (nextInsertToken === null || nextOriginalTokenEndOffset <= nextInsertToken.offset)) {
238 > // original token ends before next insert token
239 > text += this._text.substring(originalEndOffset, nextOriginalTokenEndOffset);
240 > const metadata = this._tokens[(nextOriginalTokenIdx << 1) + 1];
241 > newTokens.push(text.length, metadata);
242 > nextOriginalTokenIdx++;
243 > originalEndOffset = nextOriginalTokenEndOffset;
244 >
245 > } else if (nextInsertToken) {
246 > if (nextInsertToken.offset > originalEndOffset) {
247 // insert token is in the middle of the next token.
248 text += this._text.substring(originalEndOffset, nextInsertToken.offset);
251 originalEndOffset = nextInsertToken.offset;
252 }
253 > lineTokens.ts
254 > text += nextInsertToken.text;
255 > newTokens.push(text.length, nextInsertToken.tokenMetadata);
256 > nextInsertTokenIdx++;
257 > } else {
258 > break;
259 > }
260 > }
261 >
262 > return new LineTokens(new Uint32Array(newTokens), text, this.languageIdCodec);
263 > }
264
265 public getTokensInRange(range: OffsetRange): TokenArray {

Direct hierarchy

Parents

Children