How to extract the data from a electrical circuit diagram using Microsoft Document intelligence

Ajeet Ojha 0

Hello, I have many complex circuit diagrams, i am using Azure AI document intelligence , I want to extract only paragraphs which is being shown as result of analysis of document in Azure Document intelligence , when i see the json output it gives content as words, i want the whole paragraph. can some please help with a python code to do this . also i want to run this whole process from my laptop, if someoen can please give a code for this as well pls.

Sina Salam 12,011 Reputation points

2024-06-23T03:34:11.91+00:00

Hi Ajeet Ojha,

Can you clarify that:

You want to extract only paragraphs from JSON output?

or

You want that paragraphs from Azure Document intelligence?

Hope to read from you.

Regards,

Sina
Ajeet Ojha 0 Reputation points

2024-06-23T07:40:17.16+00:00

Thank you for your kind response @Sina Salam , I want to read the paragraphs/ lines only , if there is a way to read directly that is also fine, else , from the json output is also good for me. my goal is the read the lines and paragraph but not the individual word in my final output which i want to generate. any help greatly appreciated as i am little new to this.
Sina Salam 12,011 Reputation points

2024-06-23T15:27:06.03+00:00
Hello @Ajeet Ojha

Thank you for your response.

Solution

To extract paragraphs from the JSON output provided by Azure AI Document Intelligence, you'll need to parse the JSON and reconstruct the paragraphs from the individual words. I put together a step-by-step guide and corresponding Python code to help you achieve this.

Set Up Your Environment:

Ensure you have Python installed on your laptop.

Install necessary libraries using pip: pip install requests

Get JSON Output from Azure Document Intelligence: This example assumes you already have the JSON output saved to a file called output.json.

Parse the JSON and Reconstruct Paragraphs:

Load the JSON file.

Iterate through the JSON structure to extract words and their positions.

Reconstruct paragraphs based on word positions and sequences.

The example of python code that can perform the number 3 above:

import json def extract_paragraphs(json_data): # This function extracts paragraphs from the Azure Document Intelligence JSON output paragraphs = [] for page in json_data['analyzeResult']['readResults']: for line in page['lines']: paragraph = " ".join([word['text'] for word in line['words']]) paragraphs.append(paragraph) return paragraphs def main(): # Load JSON data from a file with open('output.json', 'r') as file: json_data = json.load(file) # Extract paragraphs paragraphs = extract_paragraphs(json_data) # Print extracted paragraphs for i, paragraph in enumerate(paragraphs): print(f"Paragraph {i+1}: {paragraph}\n") if __name__ == "__main__": main()

This is an explanation and things you will need to do:

The main function opens and reads the JSON data from output.json. Also, the extract_paragraphs function processes the JSON data. It assumes that each page contains lines, and each line contains words. It concatenates words to form lines (which are treated as paragraphs here). Then, the paragraphs are printed to the console.

What to do to make the script work:

Save the JSON output from Azure Document Intelligence to a file named output.json.

Save the Python script above to a file, e.g., extract_paragraphs.py.

Run the script from the command line: python extract_paragraphs.py

Please kindly take notes:

Adjust the extract_paragraphs function if the JSON structure differs.

You might need additional parsing logic if your JSON has a more complex structure or if you need to differentiate between different types of text elements (e.g., paragraphs, tables, etc.) or generate output to another file format.

References

From the additional resources by the right side of this page you learn or read more on the above solution using the links below:

Extract data from forms with Azure Document intelligence - Training

Accept Answer

I hope this is helpful! Do not hesitate to let me know if you have any other questions.

** Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful ** so that others in the community facing similar issues can easily find the solution.

Best Regards,

Sina Salam

Share via

How to extract the data from a electrical circuit diagram using Microsoft Document intelligence

Solution

Your answer