404 reply when recursively listing input items with Responses API

Question

404 reply when recursively listing input items with Responses API

Ola Ingvarsson 25

When listing input items with the Responses API we get the first 20 items. When we try to list the next 20 items using last_id and the after parameter we get an error message like this:

NotFoundError: 404 No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'

We can see that the message with the above id indeed exists when we list the first 20 items.

santoshkc 14,595 Reputation points Microsoft External Staff Moderator

2025-05-07T10:47:17.5766667+00:00
Hi @Ola Ingvarsson,

Could you please provide the following additional details so I can assist you more effectively?

Are you using the Azure OpenAI Studio or through an SDK (with complete sample code)?

Which Region and Model are you using?

If possible, please provide a complete screenshot of the error you are encountering?

This will help me pinpoint the issue and suggest a more accurate solution. Thanks!

Ola Ingvarsson 25

I'm using the Javascript SDK "openai": "^4.93.0".

Here's the sample code:

const listMessages = async (responseId, lastId = null, messages = []) => {
  const response = await client.responses.inputItems.list(responseId, {
    after: lastId
  });
  
  messages.push(...response.body.data);

  const { has_more, last_id } = response.body;

  if (has_more) {
    return listMessages(responseId, last_id, messages);
  } else {
    return messages;
  }
};

You don't really use a model when listing input items but they were created with GPT-4.1 in region Sweden Central.

Here's the full error message:

NotFoundError: 404 No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'
    at APIError.generate (/app/node_modules/openai/error.js:54:20)
    at AzureOpenAI.makeStatusError (/app/node_modules/openai/core.js:302:33)
    at AzureOpenAI.makeRequest (/app/node_modules/openai/core.js:346:30)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async listMessages (/app/utils/responses-api.js:4:20) {
  status: 404,
  headers: {
    'apim-request-id': 'a442067c-f957-4bb4-ab95-5c72b4c8d977',
    'content-length': '191',
    'content-type': 'application/json',
    date: 'Wed, 07 May 2025 10:02:56 GMT',
    'strict-transport-security': 'max-age=31536000; includeSubDomains; preload',
    'x-content-type-options': 'nosniff',
    'x-ms-region': 'Sweden Central'
  },
  request_id: undefined,
  error: {
    message: "No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'",
    type: 'invalid_request_error',
    param: 'after',
    code: null
  },
  code: null,
  param: 'after',
  type: 'invalid_request_error'
}

Ola Ingvarsson 25

I'm using the Javascript SDK "openai": "^4.93.0".

Here's the sample code:

const listMessages = async (responseId, lastId = null, messages = []) => {
  const response = await client.responses.inputItems.list(responseId, {
    after: lastId
  });
  
  messages.push(...response.body.data);

  const { has_more, last_id } = response.body;

  if (has_more) {
    return listMessages(responseId, last_id, messages);
  } else {
    return messages;
  }
};

You don't really use a model when listing input items but they were created with GPT-4.1 in region Sweden Central.

Here's the full error message:

NotFoundError: 404 No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'
    at APIError.generate (/app/node_modules/openai/error.js:54:20)
    at AzureOpenAI.makeStatusError (/app/node_modules/openai/core.js:302:33)
    at AzureOpenAI.makeRequest (/app/node_modules/openai/core.js:346:30)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async listMessages (/app/utils/responses-api.js:4:20) {
  status: 404,
  headers: {
    'apim-request-id': 'a442067c-f957-4bb4-ab95-5c72b4c8d977',
    'content-length': '191',
    'content-type': 'application/json',
    date: 'Wed, 07 May 2025 10:02:56 GMT',
    'strict-transport-security': 'max-age=31536000; includeSubDomains; preload',
    'x-content-type-options': 'nosniff',
    'x-ms-region': 'Sweden Central'
  },
  request_id: undefined,
  error: {
    message: "No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'",
    type: 'invalid_request_error',
    param: 'after',
    code: null
  },
  code: null,
  param: 'after',
  type: 'invalid_request_error'
}

Manas Mohanty 4,130 Reputation points Microsoft External Staff Moderator

2025-05-07T17:04:53.32+00:00

Hi Ola Ingvarsson

We checked internally on this case. There seems to be few product group tickets mentioning East US 2 and UK South on Responses API but not Sweden Central

Could you share a full working code hiding Api key and endpoint details. Current shared code is not clear enough to replicate.

Thank you for the collaboration.

Ola Ingvarsson 25

Hi,

Here is a complete code example:

const { AzureOpenAI } = require('openai');

const client = new AzureOpenAI({
  apiKey: AZURE_OPENAI_KEY,
  apiVersion: '2025-03-01-preview',
  endpoint: AZURE_OPENAI_ENDPOINT
});

const listMessages = async (responseId, lastId = null, messages = []) => {
  const response = await client.responses.inputItems.list(responseId, {
    after: lastId
  });
  
  messages.push(...response.body.data);

  const { has_more, last_id } = response.body;

  if (has_more) {
    return listMessages(responseId, last_id, messages);
  } else {
    return messages;
  }
};

listMessages(RESPONSE_ID).then(console.log).catch(console.error);

JAYA SHANKAR G S 2,775 Reputation points Microsoft External Staff Moderator

2025-05-12T03:54:05.3266667+00:00

Hello @Ola Ingvarsson ,

We are able to reproduce the issue, checking with internal product team and will update once we get the details.

Thank you

Your answer

santoshkc 14,595 Reputation points Microsoft External Staff Moderator

2025-05-07T10:47:17.5766667+00:00

Hi @Ola Ingvarsson,

Could you please provide the following additional details so I can assist you more effectively?

Are you using the Azure OpenAI Studio or through an SDK (with complete sample code)?

Which Region and Model are you using?

If possible, please provide a complete screenshot of the error you are encountering?

This will help me pinpoint the issue and suggest a more accurate solution. Thanks!
Ola Ingvarsson 25 Reputation points

2025-05-07T11:45:16.42+00:00

I'm using the Javascript SDK "openai": "^4.93.0".

Here's the sample code:

const listMessages = async (responseId, lastId = null, messages = []) => { const response = await client.responses.inputItems.list(responseId, { after: lastId }); messages.push(...response.body.data); const { has_more, last_id } = response.body; if (has_more) { return listMessages(responseId, last_id, messages); } else { return messages; } };

You don't really use a model when listing input items but they were created with GPT-4.1 in region Sweden Central.

Here's the full error message:

NotFoundError: 404 No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5' at APIError.generate (/app/node_modules/openai/error.js:54:20) at AzureOpenAI.makeStatusError (/app/node_modules/openai/core.js:302:33) at AzureOpenAI.makeRequest (/app/node_modules/openai/core.js:346:30) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async listMessages (/app/utils/responses-api.js:4:20) { status: 404, headers: { 'apim-request-id': 'a442067c-f957-4bb4-ab95-5c72b4c8d977', 'content-length': '191', 'content-type': 'application/json', date: 'Wed, 07 May 2025 10:02:56 GMT', 'strict-transport-security': 'max-age=31536000; includeSubDomains; preload', 'x-content-type-options': 'nosniff', 'x-ms-region': 'Sweden Central' }, request_id: undefined, error: { message: "No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'", type: 'invalid_request_error', param: 'after', code: null }, code: null, param: 'after', type: 'invalid_request_error' }
Ola Ingvarsson 25 Reputation points

2025-05-07T11:50:40.4866667+00:00

I'm using the Javascript SDK "openai": "^4.93.0".

Here's the sample code:

const listMessages = async (responseId, lastId = null, messages = []) => { const response = await client.responses.inputItems.list(responseId, { after: lastId }); messages.push(...response.body.data); const { has_more, last_id } = response.body; if (has_more) { return listMessages(responseId, last_id, messages); } else { return messages; } };

You don't really use a model when listing input items but they were created with GPT-4.1 in region Sweden Central.

Here's the full error message:

NotFoundError: 404 No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5' at APIError.generate (/app/node_modules/openai/error.js:54:20) at AzureOpenAI.makeStatusError (/app/node_modules/openai/core.js:302:33) at AzureOpenAI.makeRequest (/app/node_modules/openai/core.js:346:30) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async listMessages (/app/utils/responses-api.js:4:20) { status: 404, headers: { 'apim-request-id': 'a442067c-f957-4bb4-ab95-5c72b4c8d977', 'content-length': '191', 'content-type': 'application/json', date: 'Wed, 07 May 2025 10:02:56 GMT', 'strict-transport-security': 'max-age=31536000; includeSubDomains; preload', 'x-content-type-options': 'nosniff', 'x-ms-region': 'Sweden Central' }, request_id: undefined, error: { message: "No item found with id 'msg_681b2a06fbfc8190b8028aa84411af720d7696e647f77df5'", type: 'invalid_request_error', param: 'after', code: null }, code: null, param: 'after', type: 'invalid_request_error' }
Manas Mohanty 4,130 Reputation points Microsoft External Staff Moderator

2025-05-07T17:04:53.32+00:00

Hi Ola Ingvarsson

We checked internally on this case. There seems to be few product group tickets mentioning East US 2 and UK South on Responses API but not Sweden Central

Could you share a full working code hiding Api key and endpoint details. Current shared code is not clear enough to replicate.

Thank you for the collaboration.
Ola Ingvarsson 25 Reputation points

2025-05-08T09:20:13.7366667+00:00

Hi,

Here is a complete code example:

const { AzureOpenAI } = require('openai'); const client = new AzureOpenAI({ apiKey: AZURE_OPENAI_KEY, apiVersion: '2025-03-01-preview', endpoint: AZURE_OPENAI_ENDPOINT }); const listMessages = async (responseId, lastId = null, messages = []) => { const response = await client.responses.inputItems.list(responseId, { after: lastId }); messages.push(...response.body.data); const { has_more, last_id } = response.body; if (has_more) { return listMessages(responseId, last_id, messages); } else { return messages; } }; listMessages(RESPONSE_ID).then(console.log).catch(console.error);
JAYA SHANKAR G S 2,775 Reputation points Microsoft External Staff Moderator

2025-05-12T03:54:05.3266667+00:00

Hello @Ola Ingvarsson ,

We are able to reproduce the issue, checking with internal product team and will update once we get the details.

Thank you

Share via

404 reply when recursively listing input items with Responses API

Your answer