Decrypt Value From Outside Source in Azure Databricks

Question

Hi Team,

I am Getting a value from On-Prem(AB Initio ETL tool) with Encrypted using below function from thier end....

m_eval 'string_to_hex(encrypt_aes_simple("Field-value","{Key}"))'
"DEB48636106FEEEFB1CEA0DD26F2CE2D"

I want to decrypt the value in Azure Databricks...

I tried below and was getting error

val hex = spark.sql("""select aes_decrypt(decode(unhex("DEB48636106FEEEFB1CEA0DD26F2CE2D"),"UTF-8"),'{key}') AS VALUE""")

SparkRuntimeException: The value of parameter(s) 'expr, key' in the aes_encrypt/aes_decrypt function is invalid: Detail message: Input too short - need tag

Please suggest a solution for the same....

Answer 1

Hello @Jaganathan, Naveen ,

Thanks for the question and using MS Q&A platform.

As the error message clearly says, that the value you provided for the encrypted binary expression parameter (nothing but Field-value in your example) is not correct or incomplete or shorter than it has to be which is why you are seeing the above error message.

I tried to reproduce the same using a sample below and was able to reproduce the issue by passing a shorter binary expression parameter value while decrypting. Please see below

But when I have provided the accurate/correct encrypted binary expression parameter value for the decryption, then it works as expected. Please see below:

Hence, I would recommend making sure you are passing the correct encrypted binary expression parameter value to aes_decrypt() function.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how