This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 92%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAJ%3C/text%3E%3C/svg%3E)
We have a cube which currently reads data from two separate partitions for the same measure group. By separate partitions, I mean coming from different tables. Then we have scope statements, which decides at which hierarchy level, what we show in our cube...i.e at certain level, cube shows numbers from Table_1 and at higher levels, cube shows numbers from Table_B. What is going on is, at random times after processing these partitions, I get correct number and at other times some numbers are doubling . Any reason what maybe going on? I have checked the source queries and they look good. The dimension tables look good. For example yesterday the data for July was wrong, and today the data for August is wrong.
And then on re-processing it, the data gets fixed.
It seems like for whatever reasons , we are appending to the existing data instead of replacing.
Our source is Google Big Query
Driver is CDATA Driver
The partitions are processed in batch for 3 months at a time. I.e. each batch has six partitions each month has 2 partitions, one for class and another for vendor.
Class is the one which goes bad from time to time.
A Microsoft online analytical data engine used in decision support and business analytics, providing the analytical data for business reports and client applications such as Power BI, Excel, Reporting Services reports, and other data visualization tools.
Additional SQL Server features and topics not covered by specific categories
Hello Alexei,
The source is correct because I captured the query at the time the cube was processed.
The query didn't result in duplicates which we noticed in the cube.
I didnt' see partition files.All I see is the file for the measure group with the names with suffix ".map", ".hdr" and ".data' files.
Is there a place where we get the files at partition level?
Thanks
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 95%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Why, there's a folder tree in the OLAP data folder, or wherever you chose to save the data for this particular OLAP database, and you have a folder hierarchy with *.db folder for database, then *.cub folder for cube, *.det for measure group, *.prt for partition, and within you have the actual files containing data. *.fact.data is where partition's base data is stored.
You'll need to compare the sizes for the same partition in its ok state vs. its supposedly duplicated state.
You got something wrong in your description. SCOPE statements are unaware of measure group partitioning, so your cube actually runs on some logic different from what you described.
Also, you haven't really provided any proof that the source is in fact correct. You might actually run into intermittent problems with the source for all you've posted so far.
It should be easy to check whether the data is actually duplicating by examining the sizes of partition files.