Need suggestion for good storage of data in azure like an RDBMS
Hi, We have a requirement where we want extract information from multiple payload json file which will be in blob storage and so many internal products will be pushing these files in azure data lake storage. Our goal is to extract the data from these…
Azure Synapse Analytics
Connect to Serverless SQL Pool using Synapse Notebook
I'm trying to connect my database in serverless sql pool and create/drop some external tables in synapse notebook. I'm using below to connect to the sql: jdbc_url =…
Azure Synapse Analytics
Not able to truncate heap table
Hi team , This morning, we encountered an issue with the heap table—we attempted to truncate it, but the process has been running indefinitely. Could there be an issue on Azure's side?
Azure Synapse Analytics
Permission to turn on Interactive Authoring in Azure Synapse Analytics
I'm a part of team that regularly ingests external files/tables using activity pipelines. To do this I need to turn on interactive authoring. I've been given Admin access to the site, but I always have to ask my boss to activate it because for some…
Azure Synapse Analytics
Synapse workspace - Realtime data
Hi, Can you suggest a web link which I can study and use it to convince the management to use synapse workspace to process realtime data and capture them for presentation? Thank you
Azure Synapse Analytics
@@LANGID is not supported in Microsoft SQL Azure (RTM) - 12.0.2000.8 (Azure Synapse) - most accurate way of determining the LANGID?
As per the title, according to https://learn.microsoft.com/en-us/sql/t-sql/functions/langid-transact-sql?view=sql-server-ver17&viewFallbackFrom=azure-sqldw-latest, LANGID is not supported in Azure Synapse. What's the recommended (most accurate) way…
Azure Synapse Analytics
Issue with partitioned views/snapshot tables in azure synapse/ADLS
There seems to be an issue with the partitioned views (which run off the snapshot csv's in ADLS) for our data (we use Azure Synapse Link for Dataverse). Querying these views doesn't fail, but it cannot read all records in an entity, which is causing…
Azure Synapse Analytics
Unexpected $500 Billing for Azure Synapse
I activated the Azure Synapse service on August 1st using the default settings. However, I noticed that I am being billed $250 per day, which has accumulated to a total of $500 over the last two days. As a student, I am using this service solely for…
Azure Cost Management
Azure Synapse Analytics
Azure Data Factory

I need to get the Synapse workspace Outbound IP address for my workspace
I need to get the Synapse workspace Outbound IP address for my workspace
Azure Synapse Analytics
The dedicated sql pool memory usage is constantly 95%-96% without any activity. It's running on DW300c service level. Is there a way to find out what exactly is utilizing this much memory?
The dedicated sql pool memory usage is constantly 95%-96% without any activity. It's running on DW300c service level. Is there a way to find out what exactly is utilizing this much memory? I'm trying to avoid increasing the service level without finding…
Azure Synapse Analytics
Getting Error: Failed to save Arm Templates. Error: { "message": "Sorry, your input was too large to process.
We merged Pull requests which contained many changes in Synapse pipelines and then we were trying to publish the changes and generate a ARM template. Publish was successful The generation of ARM template got failed. Generating templates Failed to…
Azure Synapse Analytics
Dataverse Synapse Link to Lake Database pulling Date and Datetime fields.
Our Dynamics Dataverse is using the Synapse Data Link to move data to Azure Data Lake gen 2. We then use a Synapse Analytics Data flows to transform the data to a Lake Database parquet file. Up until last week this was working great, but recently any…
Azure Synapse Analytics
Not able to create an azure synaps analytics workspace in west europe
I'm trying to create an Azure Synapse Analytics workspace located in westeurope but when I try, I recieve the error: {"code":"ValidationFailed","message":"Workspace request validation failed, check error details for…
Azure Synapse Analytics
Using filepath() in synapse
I created an extrenal table in synapse and try to use filepath function on it, but got below error: Here is my table: CREATE EXTERNAL TABLE bronze.trip_data_green_csv ( VendorID INT, lpep_pickup_datetime datetime2(7), …
Azure Synapse Analytics
There are not enough vcores resources available in the workspace while running the synapse dataflows
Hi Team, we are getting the below error dataflow while running in for each activity, Could you please help us to fix this **There are not enough resources available in the workspace, details: 'Your job requested 8 vcores. However, the workspace…
Azure Synapse Analytics
Azure Synapse Runtime for Apache Spark 3.5 Java Version
The recently released Azure Synapse Runtime for Apache Spark 3.5 mentions support for Java 17. However, the Github page for this runtime specifies Java version 11.0.27…
Azure Synapse Analytics
Activating Inactive Data Explorer Database from 'Add Resources'
The Data Explorer database from the 'Add Resources' section appears to be inactive in the drop-down menu. What steps are needed to activate it?
Azure Synapse Analytics
Does Synapse Dedicated SQL Pool support wildcards in the LOCATION of external tables?
Does Synapse Dedicated SQL Pool support wildcards in the LOCATION of external tables like below: CREATE EXTERNAL TABLE db_public.trip_data_green_csv ( VendorID INT, lpep_pickup_datetime datetime2(7), lpep_dropoff_datetime…
Azure Synapse Analytics
User Name and Password for Dedicate SQL Pool
I created a dedicated sql pool in my synapse work space and try to connect to it using DBeaver, but I don't know my user name and password, I didn't remember I set them when I created the dedicated sql pool.
Azure Synapse Analytics
How to find the reason behind org.apache.spark.sql.delta.DeltaErrorsBase.invalidCommittedVersion
I have a notebook that for several tables fetch a new version of the table from landing (ASDLGen2) and overwrite the existing DeltaTable (external) with the new version.…