Vihren Atlas

visibility_archiver.go ×11

Code frontier

unlabeled · c_ef962a255115

3 tests · 2010 LOC · 88 files · introduces 0 tests · 57 LOC · 3 files

Introduces — evidence that enters the hierarchy at this concept

Code
17 ranges57 lines · 3 files
Tests
0 tests

Contains — complete concept membership

All code (extent)
305 ranges2010 lines · 88 files · Browse complete extent
All tests (intent)
3 testsBrowse complete intent

Neighbourhood graph

The orange circle is the focus. Violet and green circles are every ancestor and descendant, broader and narrower, at any distance; blue squares and pink diamonds are the introduced files and exact introduced tests of every visible concept, not only the focus's. Arrows point from broader to narrower concepts and bridge only concepts omitted from this view. Undirected links show source or test introduction. Concept and file size follows LOC; exact test nodes use test-count units.

Introduced files, introduced tests, and structurally relevant concept specialization

In the embedded map, ordinary wheel input scrolls the page; use the visible controls to zoom and drag to pan. Open the full-screen map for canvas navigation: wheel pans, Ctrl/Command plus wheel zooms, and arrow keys pan when this region is focused. On touch screens, open the full-screen map to pan or pinch. If JavaScript or WebGL is unavailable, use the native relationship evidence on this page.

Introduced files, introduced tests, and structurally relevant concept specializationTestQuery_Success_SmallPageSize · 0 introduced LOCTestQuery_Success_SmallP…visibility_archiver.go ×3 · 6 introduced LOCvisibility_archiver.go ×…visibility_archiver.go ×2 · 11 introduced LOCvisibility_archiver.go ×…visibility_archiver.go ×2 · 6 introduced LOCvisibility_archiver.go ×…visibility_archiver.go ×2 · 6 introduced LOCvisibility_archiver.go ×…visibility_archiver.go ×1 · 1 introduced LOCvisibility_archiver.go ×…visibility_archiver.go ×1 · 1 introduced LOCvisibility_archiver.go ×…stringify.go ×1 · 2 introduced LOCstringify.go ×1visibility_archiver.go ×3 · 4 introduced LOCvisibility_archiver.go ×…visibility_archiver.go ×1 · 3 introduced LOCvisibility_archiver.go ×…message.pb.go ×1 · 6 introduced LOCmessage.pb.go ×1query_parser.go ×1 · 11 introduced LOCquery_parser.go ×1util.go ×1 · 1 introduced LOCutil.go ×1client_mock.go ×2 · 11 introduced LOCclient_mock.go ×2util.go ×1 · 1 introduced LOCutil.go ×1util.go ×1 · 2 introduced LOCutil.go ×1visibility_archiver.go ×3 · 8 introduced LOCvisibility_archiver.go ×…message.pb.go ×2 · 6 introduced LOCmessage.pb.go ×2client_mock.go ×3 · 14 introduced LOCclient_mock.go ×3message.pb.go ×1 · 4 introduced LOCmessage.pb.go ×1message.pb.go ×1 · 4 introduced LOCmessage.pb.go ×1time.go ×1 · 3 introduced LOCtime.go ×1client_mock.go ×1 · 5 introduced LOCclient_mock.go ×1uri.go ×1 · 3 introduced LOCuri.go ×1uri.go ×1 · 3 introduced LOCuri.go ×1uri.go ×1 · 3 introduced LOCuri.go ×1time.go ×2 · 3 introduced LOCtime.go ×2uri.go ×1 · 1 introduced LOCuri.go ×1uri.go ×1 · 3 introduced LOCuri.go ×1util.go ×1 · 3 introduced LOCutil.go ×1message.pb.go ×2 · 20 introduced LOCmessage.pb.go ×2test_provider.go ×1 · 4 introduced LOCtest_provider.go ×1name_type_map.go ×1 · 7 introduced LOCname_type_map.go ×1stringify.go ×1 · 2 introduced LOCstringify.go ×1constants.go ×2 · 6 introduced LOCconstants.go ×2time.go ×1 · 3 introduced LOCtime.go ×1noop_moving_window_average.go ×1 · 2 introduced LOCnoop_moving_window_avera…search_attribute.go ×12 · 121 introduced LOCsearch_attribute.go ×12key.go ×1 · 6 introduced LOCkey.go ×1priority.go ×1 · 3 introduced LOCpriority.go ×1setting_gen.go ×51 · 335 introduced LOCsetting_gen.go ×51grpc_resolver.go ×2 · 7 introduced LOCgrpc_resolver.go ×2predicates.pb.go ×21 · 54 introduced LOCpredicates.pb.go ×21service.pb.go ×2 · 342 introduced LOCservice.pb.go ×2message.pb.go ×2 · 20 introduced LOCmessage.pb.go ×2constants.go ×3 · 11 introduced LOCconstants.go ×3constants.go ×1 · 3 introduced LOCconstants.go ×1constants.go ×1 · 6 introduced LOCconstants.go ×1task.pb.go ×1 · 3 introduced LOCtask.pb.go ×1message.pb.go ×2 · 442 introduced LOCmessage.pb.go ×2defs.go ×5 · 91 introduced LOCdefs.go ×5noop_logger.go ×1 · 3 introduced LOCnoop_logger.go ×1tags.go ×9 · 37 introduced LOCtags.go ×9message.pb.go ×2 · 49 introduced LOCmessage.pb.go ×2cluster.pb.go ×2 · 200 introduced LOCcluster.pb.go ×2wildcard.go ×1 · 2 introduced LOCwildcard.go ×1wildcard.go ×4 · 14 introduced LOCwildcard.go ×4retrypolicy.go ×3 · 19 introduced LOCretrypolicy.go ×3jsonpb.go ×1 · 3 introduced LOCjsonpb.go ×1message.pb.go ×2 · 20 introduced LOCmessage.pb.go ×2jsonpb.go ×1 · 3 introduced LOCjsonpb.go ×1payload.go ×1 · 3 introduced LOCpayload.go ×1TestOperatorServiceMetadata, TestWorkflowServiceMetadata · 0 introduced LOCTestOperatorServiceMetad…go.temporal.io/server/api/adminservice/v1/request_response.pb.go · 6661 LOCv1/request_response.pb.g…go.temporal.io/server/api/adminservice/v1/service.pb.go · 297 LOCv1/service.pb.gogo.temporal.io/server/api/archiver/v1/message.pb.go · 455 LOCv1/message.pb.gogo.temporal.io/server/api/chasm/v1/message.pb.go · 230 LOCv1/message.pb.gogo.temporal.io/server/api/clock/v1/message.pb.go · 217 LOCv1/message.pb.gogo.temporal.io/server/api/cluster/v1/message.pb.go · 366 LOCv1/message.pb.gogo.temporal.io/server/api/common/v1/api_category.pb.go · 230 LOCv1/api_category.pb.gogo.temporal.io/server/api/common/v1/dlq.pb.go · 319 LOCv1/dlq.pb.gogo.temporal.io/server/api/deployment/v1/message.pb.go · 4650 LOCv1/message.pb.gogo.temporal.io/server/api/enums/v1/cluster.pb.go · 233 LOCv1/cluster.pb.gogo.temporal.io/server/api/enums/v1/common.pb.go · 288 LOCv1/common.pb.gogo.temporal.io/server/api/enums/v1/dlq.pb.go · 211 LOCv1/dlq.pb.gogo.temporal.io/server/api/enums/v1/fairness_state.pb.go · 147 LOCv1/fairness_state.pb.gogo.temporal.io/server/api/enums/v1/nexus.pb.go · 182 LOCv1/nexus.pb.gogo.temporal.io/server/api/enums/v1/predicate.pb.go · 194 LOCv1/predicate.pb.gogo.temporal.io/server/api/enums/v1/replication.pb.go · 338 LOCv1/replication.pb.gogo.temporal.io/server/api/enums/v1/task.pb.go · 480 LOCv1/task.pb.gogo.temporal.io/server/api/enums/v1/workflow.pb.go · 299 LOCv1/workflow.pb.gogo.temporal.io/server/api/enums/v1/workflow_task_type.pb.go · 148 LOCv1/workflow_task_type.pb…go.temporal.io/server/api/errordetails/v1/message.pb.go · 649 LOCv1/message.pb.gogo.temporal.io/server/api/health/v1/message.pb.go · 324 LOCv1/message.pb.gogo.temporal.io/server/api/history/v1/message.pb.go · 522 LOCv1/message.pb.gogo.temporal.io/server/api/historyservice/v1/request_response.pb.go · 12003 LOCv1/request_response.pb.g…go.temporal.io/server/api/historyservice/v1/service.pb.go · 452 LOCv1/service.pb.gogo.temporal.io/server/api/matchingservice/v1/request_response.pb.go · 6878 LOCv1/request_response.pb.g…go.temporal.io/server/api/matchingservice/v1/service.pb.go · 274 LOCv1/service.pb.gogo.temporal.io/server/api/metrics/v1/message.pb.go · 128 LOCv1/message.pb.gogo.temporal.io/server/api/namespace/v1/message.pb.go · 138 LOCv1/message.pb.gogo.temporal.io/server/api/persistence/v1/chasm.pb.go · 1215 LOCv1/chasm.pb.gogo.temporal.io/server/api/persistence/v1/chasm_visibility.pb.go · 170 LOCv1/chasm_visibility.pb.g…go.temporal.io/server/api/persistence/v1/cluster_metadata.pb.go · 313 LOCv1/cluster_metadata.pb.g…go.temporal.io/server/api/persistence/v1/executions.pb.go · 5768 LOCv1/executions.pb.gogo.temporal.io/server/api/persistence/v1/history_tree.pb.go · 298 LOCv1/history_tree.pb.gogo.temporal.io/server/api/persistence/v1/hsm.pb.go · 929 LOCv1/hsm.pb.gogo.temporal.io/server/api/persistence/v1/namespaces.pb.go · 560 LOCv1/namespaces.pb.gogo.temporal.io/server/api/persistence/v1/nexus.pb.go · 509 LOCv1/nexus.pb.gogo.temporal.io/server/api/persistence/v1/predicates.go-helpers.pb.go · 413 LOCv1/predicates.go-helpers…go.temporal.io/server/api/persistence/v1/predicates.pb.go · 864 LOCv1/predicates.pb.gogo.temporal.io/server/api/persistence/v1/queue_metadata.pb.go · 129 LOCv1/queue_metadata.pb.gogo.temporal.io/server/api/persistence/v1/queues.pb.go · 641 LOCv1/queues.pb.gogo.temporal.io/server/api/persistence/v1/task_queues.pb.go · 924 LOCv1/task_queues.pb.gogo.temporal.io/server/api/persistence/v1/tasks.pb.go · 870 LOCv1/tasks.pb.gogo.temporal.io/server/api/persistence/v1/update.pb.go · 455 LOCv1/update.pb.gogo.temporal.io/server/api/persistence/v1/workflow_mutable_state.pb.go · 560 LOCv1/workflow_mutable_stat…go.temporal.io/server/api/replication/v1/message.pb.go · 2481 LOCv1/message.pb.gogo.temporal.io/server/api/taskqueue/v1/message.pb.go · 1363 LOCv1/message.pb.gogo.temporal.io/server/api/token/v1/message.pb.go · 809 LOCv1/message.pb.gogo.temporal.io/server/api/visibilityservice/v1/request_response.pb.go · 426 LOCv1/request_response.pb.g…go.temporal.io/server/api/workflow/v1/message.pb.go · 302 LOCv1/message.pb.gogo.temporal.io/server/chasm/library.go · 60 LOCchasm/library.gogo.temporal.io/server/chasm/registrable_component.go · 233 LOCchasm/registrable_compon…go.temporal.io/server/chasm/search_attribute.go · 525 LOCchasm/search_attribute.g…go.temporal.io/server/common/aggregate/noop_moving_window_average.go · 13 LOCaggregate/noop_moving_wi…go.temporal.io/server/common/archiver/gcloud/connector/client_mock.go · 118 LOCconnector/client_mock.gogo.temporal.io/server/common/archiver/gcloud/query_parser.go · 203 LOCgcloud/query_parser.gogo.temporal.io/server/common/archiver/gcloud/util.go · 225 LOCgcloud/util.gogo.temporal.io/server/common/archiver/gcloud/visibility_archiver.go · 311 LOCgcloud/visibility_archiv…go.temporal.io/server/common/archiver/uri.go · 79 LOCarchiver/uri.gogo.temporal.io/server/common/archiver/util.go · 122 LOCarchiver/util.gogo.temporal.io/server/common/backoff/retrypolicy.go · 347 LOCbackoff/retrypolicy.gogo.temporal.io/server/common/build/build.go · 56 LOCbuild/build.gogo.temporal.io/server/common/codec/jsonpb.go · 147 LOCcodec/jsonpb.gogo.temporal.io/server/common/dynamicconfig/collection.go · 779 LOCdynamicconfig/collection…go.temporal.io/server/common/dynamicconfig/deepcopy.go · 78 LOCdynamicconfig/deepcopy.g…go.temporal.io/server/common/dynamicconfig/gradual_change.go · 196 LOCdynamicconfig/gradual_ch…go.temporal.io/server/common/dynamicconfig/key.go · 21 LOCdynamicconfig/key.gogo.temporal.io/server/common/dynamicconfig/registry.go · 44 LOCdynamicconfig/registry.g…go.temporal.io/server/common/dynamicconfig/setting_gen.go · 1972 LOCdynamicconfig/setting_ge…go.temporal.io/server/common/dynamicconfig/shared_structure.go · 69 LOCdynamicconfig/shared_str…go.temporal.io/server/common/log/noop_logger.go · 25 LOClog/noop_logger.gogo.temporal.io/server/common/log/tag/tags.go · 1039 LOCtag/tags.gogo.temporal.io/server/common/log/tag/zap_tag.go · 242 LOCtag/zap_tag.gogo.temporal.io/server/common/membership/grpc_resolver.go · 169 LOCmembership/grpc_resolver…go.temporal.io/server/common/metrics/defs.go · 76 LOCmetrics/defs.gogo.temporal.io/server/common/metrics/defs_base.go · 30 LOCmetrics/defs_base.gogo.temporal.io/server/common/metrics/noop_impl.go · 58 LOCmetrics/noop_impl.gogo.temporal.io/server/common/metrics/option.go · 21 LOCmetrics/option.gogo.temporal.io/server/common/metrics/registry.go · 75 LOCmetrics/registry.gogo.temporal.io/server/common/payload/payload.go · 127 LOCpayload/payload.gogo.temporal.io/server/common/persistence/noop_health_signal_aggregator.go · 31 LOCpersistence/noop_health_…go.temporal.io/server/common/primitives/timestamp/time.go · 50 LOCtimestamp/time.gogo.temporal.io/server/common/searchattribute/name_type_map.go · 190 LOCsearchattribute/name_typ…go.temporal.io/server/common/searchattribute/sadefs/constants.go · 396 LOCsadefs/constants.gogo.temporal.io/server/common/searchattribute/stringify.go · 210 LOCsearchattribute/stringif…go.temporal.io/server/common/searchattribute/test_provider.go · 161 LOCsearchattribute/test_pro…go.temporal.io/server/common/tasks/priority.go · 81 LOCtasks/priority.gogo.temporal.io/server/common/util/wildcard.go · 50 LOCutil/wildcard.gogo.temporal.io/server/service/history/tasks/key.go · 144 LOCtasks/key.goTestOperatorServiceMetadata · introduced test · go.temporal.io/server/common/api/TestOperatorServiceMetadataTestOperatorServiceMetad…TestWorkflowServiceMetadata · introduced test · go.temporal.io/server/common/api/TestWorkflowServiceMetadataTestWorkflowServiceMetad…TestConstructVisibilityFilenamePrefix · introduced test · go.temporal.io/server/common/archiver/gcloud/TestUtilSuite/TestConstructVisibilityFilenamePrefixTestConstructVisibilityF…TestQuery_EmptyQuery_Pagination · introduced test · go.temporal.io/server/common/archiver/gcloud/TestVisibilityArchiverSuiteSuite/TestQuery_EmptyQuery_PaginationTestQuery_EmptyQuery_Pag…TestQuery_Success_NoNextPageToken · introduced test · go.temporal.io/server/common/archiver/gcloud/TestVisibilityArchiverSuiteSuite/TestQuery_Success_NoNextPageTokenTestQuery_Success_NoNext…TestQuery_Success_SmallPageSize · introduced test · go.temporal.io/server/common/archiver/gcloud/TestVisibilityArchiverSuiteSuite/TestQuery_Success_SmallPageSizeTestQuery_Success_SmallP…TestNoGRPCUsage · introduced test · go.temporal.io/server/common/archiver/gcloud/connector/TestClientSuite/TestNoGRPCUsageTestNoGRPCUsageTestTSCBWithDynamicSettings · introduced test · go.temporal.io/server/common/circuitbreaker/TestTSCBWithDynamicSettingsTestTSCBWithDynamicSetti…TestDeepCopy_OtherReferenceTypes_Nil · introduced test · go.temporal.io/server/common/dynamicconfig/TestDeepCopy_OtherReferenceTypes_NilTestDeepCopy_OtherRefere…TestMutexMapBaggage · introduced test · go.temporal.io/server/common/metrics/TestBaggageBenchSuite/TestMutexMapBaggageTestMutexMapBaggageTestSyncMapBaggage · introduced test · go.temporal.io/server/common/metrics/TestBaggageBenchSuite/TestSyncMapBaggageTestSyncMapBaggageTestGetDbIndexSearchAttributesDefault · introduced test · go.temporal.io/server/common/searchattribute/sadefs/TestGetDbIndexSearchAttributesDefaultTestGetDbIndexSearchAttr…TestValidateSqlDbSystemNameToColNameMap · introduced test · go.temporal.io/server/common/searchattribute/sadefs/TestValidateSqlDbSystemNameToColNameMapTestValidateSqlDbSystemN…TestAPIPrioritiesOrdered · introduced test · go.temporal.io/server/service/matching/configs/TestQuotasSuite/TestAPIPrioritiesOrderedTestAPIPrioritiesOrderedTestAPIToPriorityMapping · introduced test · go.temporal.io/server/service/matching/configs/TestQuotasSuite/TestAPIToPriorityMappingTestAPIToPriorityMappingFocused concept · visibility_archiver.go ×11 · 57 introduced LOCvisibility_archiver.go ×…

Graph controls are ready.

Interactive rendering requires JavaScript and WebGL. Use the native relationship evidence on this page while the interactive map is unavailable.

Native relationship evidence

Every exact file and test below is linked only from the concept that introduces it.

Introduced tests

Every collected test enters the hierarchy at exactly one concept.

No tests are introduced at this concept. Its intent tests are introduced by other concepts.

Introduced code

Every collected source range enters the hierarchy at exactly one concept.

3 files ranked by introduced lines: 57 introduced LOC across 17 ranges. Expand a file to inspect source; the > gutter marks introduced lines.

go.temporal.io/server/common/archiver/gcloud/util.go 26 introduced LOC · 4 ranges

Open complete file

94 }
95
96 > func decodeVisibilityRecord(data []byte) (*archiverspb.VisibilityRecord, error) { util.go
97 > record := &archiverspb.VisibilityRecord{}
98 > encoder := codec.NewJSONPBEncoder()
99 > err := encoder.Decode(data, record)
100 > if err != nil {
101 return nil, err
102 }
103 > return record, nil util.go
104 }
105
115 }
116
117 > func convertToExecutionInfo(record *archiverspb.VisibilityRecord, saTypeMap searchattribute.NameTypeMap) (*workflowpb.WorkflowExecutionInfo, error) { util.go
118 > searchAttributes, err := searchattribute.Parse(record.SearchAttributes, &saTypeMap)
119 > if err != nil {
120 return nil, err
121 }
122
123 > return &workflowpb.WorkflowExecutionInfo{ util.go
124 > Execution: &commonpb.WorkflowExecution{
125 > WorkflowId: record.GetWorkflowId(),
126 > RunId: record.GetRunId(),
127 > },
128 > Type: &commonpb.WorkflowType{
129 > Name: record.WorkflowTypeName,
130 > },
131 > StartTime: record.StartTime,
132 > ExecutionTime: record.ExecutionTime,
133 > CloseTime: record.CloseTime,
134 > ExecutionDuration: record.ExecutionDuration,
135 > Status: record.Status,
136 > HistoryLength: record.HistoryLength,
137 > Memo: record.Memo,
138 > SearchAttributes: searchAttributes,
139 > }, nil
140 }
141
go.temporal.io/server/common/archiver/gcloud/visibility_archiver.go 18 introduced LOC · 11 ranges

Open complete file

224 }
225
226 > filters := make([]connector.Precondition, 0) visibility_archiver.go
227 > if request.parsedQuery.workflowID != nil {
228 filters = append(filters, newWorkflowIDPrecondition(hash(*request.parsedQuery.workflowID)))
229 }
230
231 > if request.parsedQuery.runID != nil { visibility_archiver.go
232 filters = append(filters, newWorkflowIDPrecondition(hash(*request.parsedQuery.runID)))
233 }
234
235 > if request.parsedQuery.workflowType != nil { visibility_archiver.go
236 filters = append(filters, newWorkflowIDPrecondition(hash(*request.parsedQuery.workflowType)))
237 }
238
239 > filenames, completed, currentCursorPos, err := v.gcloudStorage.QueryWithFilters(ctx, uri, prefix, request.pageSize, token.Offset, filters) visibility_archiver.go
240 > if err != nil {
241 return nil, &serviceerror.InvalidArgument{Message: err.Error()}
242 }
243
244 > response := &archiver.QueryVisibilityResponse{} visibility_archiver.go
245 > for _, file := range filenames {
246 > encodedRecord, err := v.gcloudStorage.Get(ctx, uri, fmt.Sprintf("%s/%s", request.namespaceID, filepath.Base(file)))
247 > if err != nil {
248 return nil, &serviceerror.InvalidArgument{Message: err.Error()}
249 }
250
251 > record, err := decodeVisibilityRecord(encodedRecord) visibility_archiver.go
252 > if err != nil {
253 return nil, &serviceerror.InvalidArgument{Message: err.Error()}
254 }
255
256 > executionInfo, err := convertToExecutionInfo(record, saTypeMap) visibility_archiver.go
257 > if err != nil {
258 return nil, serviceerror.NewInternal(err.Error())
259 }
260 > response.Executions = append(response.Executions, executionInfo) visibility_archiver.go
261 }
262
263 > if !completed { visibility_archiver.go
264 newToken := &queryVisibilityToken{
265 Offset: currentCursorPos,
go.temporal.io/server/common/archiver/gcloud/connector/client_mock.go 13 introduced LOC · 2 ranges

Open complete file

88
89 // QueryWithFilters mocks base method.
90 > func (m *MockClient) QueryWithFilters(ctx context.Context, URI archiver.URI, fileNamePrefix string, pageSize, offset int, filters []Precondition) ([]string, bool, int, error) { client_mock.go
91 > m.ctrl.T.Helper()
92 > ret := m.ctrl.Call(m, "QueryWithFilters", ctx, URI, fileNamePrefix, pageSize, offset, filters)
93 > ret0, _ := ret[0].([]string)
94 > ret1, _ := ret[1].(bool)
95 > ret2, _ := ret[2].(int)
96 > ret3, _ := ret[3].(error)
97 > return ret0, ret1, ret2, ret3
98 > }
99
100 // QueryWithFilters indicates an expected call of QueryWithFilters.
101 > func (mr *MockClientMockRecorder) QueryWithFilters(ctx, URI, fileNamePrefix, pageSize, offset, filters any) *gomock.Call { client_mock.go
102 > mr.mock.ctrl.T.Helper()
103 > return mr.mock.ctrl.RecordCallWithMethodType(mr.mock, "QueryWithFilters", reflect.TypeOf((*MockClient)(nil).QueryWithFilters), ctx, URI, fileNamePrefix, pageSize, offset, filters)
104 > }
105
106 // Upload mocks base method.

Direct hierarchy

Parents

Children