Bing News Search APIs limitation

이근영 1 Reputation point
2021-08-03T06:17:50.55+00:00

119950-image.png

for i in range(0,10):  
    result = get_bing_news_search(keyword = 'vaccine', numberarticle = 30, offset = i*30)  
    dfArr.append(pd.json_normalize(result['value']))  
    if i == 0 :   
          
        totalmatch = int(result['totalEstimatedMatches'])  
        print(result['totalEstimatedMatches'])  
    if i > totalmatch :  
        break  
df_total = pd.concat(dfArr)  

I want to get historical news data ( related to vaccine )
So, Use count and offset params. But there's a lot of duplicated data like the picture above

  1. Does 'Bing News Search API' have a limitation on providing only a few months of historical data or only a few number(maybe 200?) of article available?
  2. If there is any limitation, is there any way I can get news articles from years past ( long period )?

Thank you

Bing Web Search
Bing Web Search
A Bing service that gives you enhanced search details from billions of web documents.
138 questions
Bing Custom Search
Bing Custom Search
An easy-to-use, ad-free, commercial-grade search tool that lets you deliver the results you want.
81 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. romungi-MSFT 42,786 Reputation points Microsoft Employee
    2021-08-04T11:33:26.267+00:00

    @이근영 I think the usage of count and offset are correct to fetch older results. I think there should not be a limitation on the results because the field totalEstimatedMatches indicates a large no. of results. The maximum value of count seems to be 100 for news search as per documentation so the offset can be used to paginate. I have tried this scenario and the results seem to only a month old based on date published without any duplicates.

    The since parameter seems to support only trending topics to get older results directly though.

    0 comments No comments