404 reply when recursively listing input items with Responses API

Question

404 reply when recursively listing input items with Responses API

Ola Ingvarsson 25

When listing input items with the Responses API we get the first 20 items. When we try to list the next 20 items using last_id and the after parameter we get an error message like this:

NotFoundError: 404 No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'

We can see that the message with the above id indeed exists when we list the first 20 items.

santoshkc 15,345 Reputation points Microsoft External Staff Moderator

2025-05-07T10:47:17.5766667+00:00
Hi @Ola Ingvarsson,

Could you please provide the following additional details so I can assist you more effectively?

Are you using the Azure OpenAI Studio or through an SDK (with complete sample code)?

Which Region and Model are you using?

If possible, please provide a complete screenshot of the error you are encountering?

This will help me pinpoint the issue and suggest a more accurate solution. Thanks!

Ola Ingvarsson 25

I'm using the Javascript SDK "openai": "^4.93.0".

Here's the sample code:

const listMessages = async (responseId, lastId = null, messages = []) => {
  const response = await client.responses.inputItems.list(responseId, {
    after: lastId
  });
  
  messages.push(...response.body.data);

  const { has_more, last_id } = response.body;

  if (has_more) {
    return listMessages(responseId, last_id, messages);
  } else {
    return messages;
  }
};

You don't really use a model when listing input items but they were created with GPT-4.1 in region Sweden Central.

Here's the full error message:

NotFoundError: 404 No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'
    at APIError.generate (/app/node_modules/openai/error.js:54:20)
    at AzureOpenAI.makeStatusError (/app/node_modules/openai/core.js:302:33)
    at AzureOpenAI.makeRequest (/app/node_modules/openai/core.js:346:30)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async listMessages (/app/utils/responses-api.js:4:20) {
  status: 404,
  headers: {
    'apim-request-id': 'a442067c-f957-4bb4-ab95-5c72b4c8d977',
    'content-length': '191',
    'content-type': 'application/json',
    date: 'Wed, 07 May 2025 10:02:56 GMT',
    'strict-transport-security': 'max-age=31536000; includeSubDomains; preload',
    'x-content-type-options': 'nosniff',
    'x-ms-region': 'Sweden Central'
  },
  request_id: undefined,
  error: {
    message: "No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'",
    type: 'invalid_request_error',
    param: 'after',
    code: null
  },
  code: null,
  param: 'after',
  type: 'invalid_request_error'
}

Ola Ingvarsson 25

I'm using the Javascript SDK "openai": "^4.93.0".

Here's the sample code:

const listMessages = async (responseId, lastId = null, messages = []) => {
  const response = await client.responses.inputItems.list(responseId, {
    after: lastId
  });
  
  messages.push(...response.body.data);

  const { has_more, last_id } = response.body;

  if (has_more) {
    return listMessages(responseId, last_id, messages);
  } else {
    return messages;
  }
};

You don't really use a model when listing input items but they were created with GPT-4.1 in region Sweden Central.

Here's the full error message:

NotFoundError: 404 No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'
    at APIError.generate (/app/node_modules/openai/error.js:54:20)
    at AzureOpenAI.makeStatusError (/app/node_modules/openai/core.js:302:33)
    at AzureOpenAI.makeRequest (/app/node_modules/openai/core.js:346:30)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async listMessages (/app/utils/responses-api.js:4:20) {
  status: 404,
  headers: {
    'apim-request-id': 'a442067c-f957-4bb4-ab95-5c72b4c8d977',
    'content-length': '191',
    'content-type': 'application/json',
    date: 'Wed, 07 May 2025 10:02:56 GMT',
    'strict-transport-security': 'max-age=31536000; includeSubDomains; preload',
    'x-content-type-options': 'nosniff',
    'x-ms-region': 'Sweden Central'
  },
  request_id: undefined,
  error: {
    message: "No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'",
    type: 'invalid_request_error',
    param: 'after',
    code: null
  },
  code: null,
  param: 'after',
  type: 'invalid_request_error'
}

Manas Mohanty 5,940 Reputation points Microsoft External Staff Moderator

2025-05-07T17:04:53.32+00:00

Hi Ola Ingvarsson

We checked internally on this case. There seems to be few product group tickets mentioning East US 2 and UK South on Responses API but not Sweden Central

Could you share a full working code hiding Api key and endpoint details. Current shared code is not clear enough to replicate.

Thank you for the collaboration.

Ola Ingvarsson 25

Hi,

Here is a complete code example:

const { AzureOpenAI } = require('openai');

const client = new AzureOpenAI({
  apiKey: AZURE_OPENAI_KEY,
  apiVersion: '2025-03-01-preview',
  endpoint: AZURE_OPENAI_ENDPOINT
});

const listMessages = async (responseId, lastId = null, messages = []) => {
  const response = await client.responses.inputItems.list(responseId, {
    after: lastId
  });
  
  messages.push(...response.body.data);

  const { has_more, last_id } = response.body;

  if (has_more) {
    return listMessages(responseId, last_id, messages);
  } else {
    return messages;
  }
};

listMessages(RESPONSE_ID).then(console.log).catch(console.error);

JAYA SHANKAR G S 3,960 Reputation points Microsoft External Staff Moderator

2025-05-12T03:54:05.3266667+00:00

Hello @Ola Ingvarsson ,

We are able to reproduce the issue, checking with internal product team and will update once we get the details.

Thank you

1 answer

Your answer

santoshkc 15,345 Reputation points Microsoft External Staff Moderator

2025-05-07T10:47:17.5766667+00:00

Hi @Ola Ingvarsson,

Could you please provide the following additional details so I can assist you more effectively?

Are you using the Azure OpenAI Studio or through an SDK (with complete sample code)?

Which Region and Model are you using?

If possible, please provide a complete screenshot of the error you are encountering?

This will help me pinpoint the issue and suggest a more accurate solution. Thanks!
Ola Ingvarsson 25 Reputation points

2025-05-07T11:45:16.42+00:00

I'm using the Javascript SDK "openai": "^4.93.0".

Here's the sample code:

const listMessages = async (responseId, lastId = null, messages = []) => { const response = await client.responses.inputItems.list(responseId, { after: lastId }); messages.push(...response.body.data); const { has_more, last_id } = response.body; if (has_more) { return listMessages(responseId, last_id, messages); } else { return messages; } };

You don't really use a model when listing input items but they were created with GPT-4.1 in region Sweden Central.

Here's the full error message:

NotFoundError: 404 No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5' at APIError.generate (/app/node_modules/openai/error.js:54:20) at AzureOpenAI.makeStatusError (/app/node_modules/openai/core.js:302:33) at AzureOpenAI.makeRequest (/app/node_modules/openai/core.js:346:30) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async listMessages (/app/utils/responses-api.js:4:20) { status: 404, headers: { 'apim-request-id': 'a442067c-f957-4bb4-ab95-5c72b4c8d977', 'content-length': '191', 'content-type': 'application/json', date: 'Wed, 07 May 2025 10:02:56 GMT', 'strict-transport-security': 'max-age=31536000; includeSubDomains; preload', 'x-content-type-options': 'nosniff', 'x-ms-region': 'Sweden Central' }, request_id: undefined, error: { message: "No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'", type: 'invalid_request_error', param: 'after', code: null }, code: null, param: 'after', type: 'invalid_request_error' }
Ola Ingvarsson 25 Reputation points

2025-05-07T11:50:40.4866667+00:00

I'm using the Javascript SDK "openai": "^4.93.0".

Here's the sample code:

const listMessages = async (responseId, lastId = null, messages = []) => { const response = await client.responses.inputItems.list(responseId, { after: lastId }); messages.push(...response.body.data); const { has_more, last_id } = response.body; if (has_more) { return listMessages(responseId, last_id, messages); } else { return messages; } };

You don't really use a model when listing input items but they were created with GPT-4.1 in region Sweden Central.

Here's the full error message:

NotFoundError: 404 No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5' at APIError.generate (/app/node_modules/openai/error.js:54:20) at AzureOpenAI.makeStatusError (/app/node_modules/openai/core.js:302:33) at AzureOpenAI.makeRequest (/app/node_modules/openai/core.js:346:30) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async listMessages (/app/utils/responses-api.js:4:20) { status: 404, headers: { 'apim-request-id': 'a442067c-f957-4bb4-ab95-5c72b4c8d977', 'content-length': '191', 'content-type': 'application/json', date: 'Wed, 07 May 2025 10:02:56 GMT', 'strict-transport-security': 'max-age=31536000; includeSubDomains; preload', 'x-content-type-options': 'nosniff', 'x-ms-region': 'Sweden Central' }, request_id: undefined, error: { message: "No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'", type: 'invalid_request_error', param: 'after', code: null }, code: null, param: 'after', type: 'invalid_request_error' }
Manas Mohanty 5,940 Reputation points Microsoft External Staff Moderator

2025-05-07T17:04:53.32+00:00

Hi Ola Ingvarsson

We checked internally on this case. There seems to be few product group tickets mentioning East US 2 and UK South on Responses API but not Sweden Central

Could you share a full working code hiding Api key and endpoint details. Current shared code is not clear enough to replicate.

Thank you for the collaboration.
Ola Ingvarsson 25 Reputation points

2025-05-08T09:20:13.7366667+00:00

Hi,

Here is a complete code example:

const { AzureOpenAI } = require('openai'); const client = new AzureOpenAI({ apiKey: AZURE_OPENAI_KEY, apiVersion: '2025-03-01-preview', endpoint: AZURE_OPENAI_ENDPOINT }); const listMessages = async (responseId, lastId = null, messages = []) => { const response = await client.responses.inputItems.list(responseId, { after: lastId }); messages.push(...response.body.data); const { has_more, last_id } = response.body; if (has_more) { return listMessages(responseId, last_id, messages); } else { return messages; } }; listMessages(RESPONSE_ID).then(console.log).catch(console.error);
JAYA SHANKAR G S 3,960 Reputation points Microsoft External Staff Moderator

2025-05-12T03:54:05.3266667+00:00

Hello @Ola Ingvarsson ,

We are able to reproduce the issue, checking with internal product team and will update once we get the details.

Thank you

Answer 1

Hello @Ola Ingvarsson ,

We have received an update from our product team regarding the issue. It has been confirmed that there is a backend bug which causes the system to compare message IDs in different formats. Due to this mismatch, the system is unable to locate the correct message and responds with a 404 Not Found error.

At this time, there is no ETA for the resolution of this issue. However, please rest assured that our team is actively monitoring the situation, and we will keep you informed as soon as a fix is implemented.

We appreciate your patience and understanding. Please feel free to reach out if you have any further questions or concerns via comments

Thank you

Share via

404 reply when recursively listing input items with Responses API

1 answer

Your answer