convert a result of collect_list into json using spark with scala
please find the sample below -
after using below code--
val df4 = df3.groupBy("shop_id").agg(collect_list(map($"variant_id",$"variants1")) as ("variants"))
and got data like --
{"shop_id":"1","variants":[{"sku3":{"dual_price_id":-9999,"result":1}},{"sku2":{"dual_price_id":-9999,"result":1}}]}
{"shop_id":"1","variants":[{"sku10":{"dual_price_id":-9999,"result":1}},{"sku3":{"dual_price_id":-9999,"result":1}}]}
but i want data to look like --
{"shop_id":"1","variants":{"sku3":{"dual_price_id":-9999,"result":1}},{"sku2":{"dual_price_id":-9999,"result":1}}}
{"shop_id":"1","variants":{"sku10":{"dual_price_id":-9999,"result":1}},{"sku3":{"dual_price_id":-9999,"result":1}}}