Share via

send data to http

arkiboys 9,711 Reputation points
2022-03-04T14:53:38.327+00:00

Hello,
in databricks, using pyspark, I get data into dataframe and save it into .json...
Question:
How is it possible to send this data into http endpoint?
Thanks

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

0 comments No comments

Answer accepted by question author

PRADEEPCHEEKATLA 91,866 Reputation points
2022-03-07T08:10:58.433+00:00

Hello @arkiboys ,

Thanks for the question and using MS Q&A platform.

Could you please share more details on the "http endpoint" type and your requirement?

With curl you can easily perform lots of operations over an http endpoint, like PUT/POST , but other aspects should be also considered, like authentication to the http endpoint, methods supported by the http endpoint.

And also, refer to SO thread - Spark Send DataFrame as body of HTTP Post request which addressing similar ask.

Hope this will help. Please let us know if any further queries.

------------------------------

  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
  • Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Was this answer helpful?


0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.