Share via

Load data from dremio error

GAO, XIANG (uidj3604) 0 Reputation points
2023-11-15T15:02:05.69+00:00
OLE DB or ODBC error: [DataSource.Error] ERROR [HY000] [Microsoft][Drill] (1040) Drill failed to execute the query: select "TagTime",
    "Module_id",
    "ModuleAddr",
    "Co_id",
    "FirstVal",
    "LastVal",
    "CurVal",
    "Interval",
    "formatted_datetime" as "C4",
     year("formatted_datetime")  as "C1",
     month("formatted_datetime")  as "C2",
     dayofmonth("formatted_datetime")  as "C3"
from "vttjrawdata-space.Facility"."TJ_FM_RAW_RD"
where ((((((("Update_dt" >= {ts '2023-01-01 00:00:00'} and "Update_dt" < {ts '2024-01-01 00:00:00'}) and (cast("CurVal" as DOUBLE) <> 2.000000000000000E+001 or "CurVal" is null)) and (cast("CurVal" as DOUBLE) <> 0.000000000000000E+000 or "CurVal" is null)) and (cast("CurVal" as DOUBLE) <> 1.200000000000000E+000 or "CurVal" is null)) and (cast("CurVal" as DOUBLE) <> 3.200000000000000E+000 or "CurVal" is null)) and (cast("CurVal" as DOUBLE) <> 9.699999999999999E+000 or "CurVal" is null)) and (cast("CurVal" as DOUBLE) <> 1.695000000000000E+001 or "CurVal" is null)) and (cast("CurVal" as DOUBLE) <> 1.800000000000000E+001 or "CurVal" is null)
[30039]Query execution error. Details:[ 
INVALID_DATASET_METADATA ERROR: One or more of the referred data files are absent [Version of file changed PPLg-vttjrawdata/vt_fm_data_v1/FT-20231115].

SqlOperatorImpl TABLE_FUNCTION
Location 0:0:6
Fragment 0:0

[Error Id: 781399b2-6edf-4f7c-8e67-34c1b4a101a1 on 10.116.104.209:0]

  (java.lang.RuntimeException) One or more of the referred data files are absent [Version of file changed PPLg-vttjrawdata/vt_fm_data_v1/FT-20231115].
    com.dremio.exec.store.parquet.ParquetSplitReaderCreatorIterator.initSplits():391
    com.dremio.exec.store.parquet.ParquetSplitReaderCreatorIterator.filterIfNecessary():510
    com.dremio.exec.store.parquet.ParquetSplitReaderCreatorIterator.next():473
    com.dremio.exec.store.parquet.ParquetSplitReaderCreatorIterator.next():90
    com.dremio.exec.store.dfs.PrefetchingIterator.next():61
    com.dremio.exec.store.dfs.PrefetchingIterator.next():37
    com.dremio.exec.store.parquet.ScanTableFunction.setupNextReader():165
    com.dremio.exec.store.parquet.ScanTableFunction.processRow():194
    com.dremio.sabot.op.tablefunction.TableFunctionOperator.outputData():110
    com.dremio.sabot.driver.SmartOp$SmartSingleInput.outputData():209
    com.dremio.sabot.driver.StraightPipe.pump():56
    com.dremio.sabot.driver.Pipeline.doPump():124
    com.dremio.sabot.driver.Pipeline.pumpOnce():114
    com.dremio.sabot.exec.fragment.FragmentExecutor$DoAsPumper.run():544
    com.dremio.sabot.exec.fragment.FragmentExecutor.run():472
    com.dremio.sabot.exec.fragment.FragmentExecutor.access$1700():106
    com.dremio.sabot.exec.fragment.FragmentExecutor$AsyncTaskImpl.run():981
    com.dremio.sabot.task.AsyncTaskWrapper.run():121
    com.dremio.sabot.task.slicing.SlicingThread.mainExecutionLoop():249
    com.dremio.sabot.task.slicing.SlicingThread.run():171
  Caused By (java.io.FileNotFoundException) Version of file changed PPLg-vttjrawdata/vt_fm_data_v1/FT-20231115
    com.dremio.plugins.s3.store.S3AsyncByteReader.lambda$asyncReadWithRetry$2():134
    java.util.concurrent.CompletableFuture.uniExceptionally():884
    java.util.concurrent.CompletableFuture$UniExceptionally.tryFire():866
    java.util.concurrent.CompletableFuture.postComplete():488
    java.util.concurrent.CompletableFuture.completeExceptionally():1990
    software.amazon.awssdk.utils.CompletableFutureUtils.lambda$forwardExceptionTo$0():74
    java.util.concurrent.CompletableFuture.uniWhenComplete():774
    java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire():750
    java.util.concurrent.CompletableFuture.postComplete():488
    java.util.concurrent.CompletableFuture.completeExceptionally():1990
    software.amazon.awssdk.core.internal.http.pipeline.stages.AsyncApiCallMetricCollectionStage.lambda$execute$0():54
    java.util.concurrent.CompletableFuture.uniWhenComplete():774
    java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire():750
    java.util.concurrent.CompletableFuture.postComplete():488
    java.util.concurrent.CompletableFuture.completeExceptionally():1990
    software.amazon.awssdk.core.internal.http.pipeline.stages.AsyncApiCallTimeoutTrackingStage.lambda$execute$2():67
    java.util.concurrent.CompletableFuture.uniWhenComplete():774
    java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire():750
    java.util.concurrent.CompletableFuture.postComplete():488
    java.util.concurrent.CompletableFuture.completeExceptionally():1990
    software.amazon.awssdk.utils.CompletableFutureUtils.lambda$forwardExceptionTo$0():74
    java.util.concurrent.CompletableFuture.uniWhenComplete():774
    java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire():750
    java.util.concurrent.CompletableFuture.postComplete():488
    java.util.concurrent.CompletableFuture.completeExceptionally():1990
    software.amazon.awssdk.core.internal.http.pipeline.stages.AsyncRetryableStage$RetryingExecutor.maybeAttemptExecute():85
    software.amazon.awssdk.core.internal.http.pipeline.stages.AsyncRetryableStage$RetryingExecutor.maybeRetryExecute():144
    software.amazon.awssdk.core.internal.http.pipeline.stages.AsyncRetryableStage$RetryingExecutor.lambda$attemptExecute$1():133
    java.util.concurrent.CompletableFuture.uniWhenComplete():774
    java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire():750
    java.util.concurrent.CompletableFuture.postComplete():488
    java.util.concurrent.CompletableFuture.complete():1975
    software.amazon.awssdk.core.internal.http.pipeline.stages.MakeAsyncHttpRequestStage.lambda$null$0():106
    java.util.concurrent.CompletableFuture.uniWhenComplete():774
    java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire():750
    java.util.concurrent.CompletableFuture.postComplete():488
    java.util.concurrent.CompletableFuture.complete():1975
    software.amazon.awssdk.core.internal.http.pipeline.stages.MakeAsyncHttpRequestStage.lambda$executeHttpRequest$3():207
    java.util.concurrent.CompletableFuture.uniWhenComplete():774
    java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire():750
    java.util.concurrent.CompletableFuture$Completion.run():456
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():750

].
Windows for business | Windows Client for IT Pros | User experience | Other
0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.