KeyError 'raw_data'

Question

Hi there,

I am testing my deployed model on AKS using Postman. To be able to do so, I do a kubectl port-forward on an azureml-fe pod (toward port 8001). My deployment is successful, I am also able to get the swagger documentation interrogating my model.

However, when running a request on the /score endpoint I get an error linked to azure libraries. Here are the logs from the pod. I get the error even with a very simple run function that just returns a fixed value like

@input_schema('input_data', sample_input)
@output_schema(sample_output)
def run(input_data):
    return json.dumps({"hello":"world"})

Here are logs.

2022-04-08 15:44:28,832 | root | INFO | Validation Request Content-Type
2022-04-08 15:44:28,833 | root | ERROR | Encountered Exception: Traceback (most recent call last):
  File "/var/azureml-server/synchronous/routes.py", line 65, in run_scoring
    response, time_taken_ms = invoke_user_with_timer(service_input, request_headers)
  File "/var/azureml-server/synchronous/routes.py", line 102, in invoke_user_with_timer
    params = prepare_user_params(input, headers, aml_request._rawHttpRequested)
  File "/var/azureml-server/routes_common.py", line 132, in prepare_user_params
    params = {main.run_input_parameter_name: input[main.wrapped_parameter_name]}
KeyError: 'raw_data'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/azureml-envs/azureml_61774fe85dfca66c0af06d4aa0c015f2/lib/python3.8/site-packages/flask/app.py", line 1832, in full_dispatch_request
    rv = self.dispatch_request()
  File "/azureml-envs/azureml_61774fe85dfca66c0af06d4aa0c015f2/lib/python3.8/site-packages/flask/app.py", line 1818, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/var/azureml-server/synchronous/routes.py", line 44, in score_realtime
    return run_scoring(service_input, request.headers, request.environ.get('REQUEST_ID', '00000000-0000-0000-0000-000000000000'))
  File "/var/azureml-server/synchronous/routes.py", line 74, in run_scoring
    raise RunFunctionException(str(exc))
run_function_exception.RunFunctionException

2022-04-08 15:44:28,834 | root | INFO | 500
127.0.0.1 - - [08/Apr/2022:15:44:28 +0000] "POST /score HTTP/1.0" 500 10 "-" "PostmanRuntime/7.29.0"

Could you please help?

Answer 1

It is not well explained here https://learn.microsoft.com/en-us/azure/machine-learning/how-to-deploy-advanced-entry-script but the solution was actually simple. When you use @input_schema('input_data')

Your POST request should be of the form.

data = {  
    "input_data": {  
        "first_key": value,  
        "second_key": value  
    }  
}