Vincenzo Caserta is constantly exploring new innovations to improve online visibility and organic traffic. Today, he introduces IndexNow, a protocol that revolutionizes how search engines index web content.

What is IndexNow?

IndexNow is an open-source protocolAn open-source protocol is a set of publicly available rules that software uses to communicate. Anyone can view, use, or improve the code — it's free and transparent. developed by Microsoft Bing and Yandex. It's designed to instantly notify search engines when a web page is added, updated, or deleted. Unlike traditional crawlersCrawlers (or "spiders") are automated programs used by search engines to scan websites and discover content. They visit pages periodically to check for updates — but this can take days or weeks. that perform periodic scans, IndexNow sends real-time push notificationsInstead of waiting for a search engine to come check your site (pull), your site actively sends a signal saying "I have new content!" (push). It's like ringing a doorbell instead of waiting for someone to knock. to participating search engines, significantly speeding up indexationIndexation is the process by which a search engine adds your web page to its database. Until a page is indexed, it won't appear in search results..

This means that whenever content is modified, your site sends an alert to engines like Bing or Yandex, enabling faster visibility in search results and more efficient crawling.

Why is IndexNow beneficial?

  • Fast indexing: Updated content is detected almost instantly by search engines.
  • Efficiency: Reduces server loadServer load refers to the amount of work your web server has to do. When search engine bots constantly visit your site to check for changes, they consume resources. IndexNow reduces these unnecessary visits. by avoiding unnecessary crawls.
  • More control: Decide exactly which URLsA URL (Uniform Resource Locator) is simply the web address of a page — for example: https://yoursite.com/my-article. Each page on your site has a unique URL. to notify.
  • Sustainability: Fewer redundant crawls mean lower resource consumption.

How to implement IndexNow?

  1. Generate your API keyAn API key is a unique code (like a password) that identifies your website when communicating with a service. It proves that the request to index a URL is really coming from you. using Bing's official tool.
  2. Host the key in a .txt file at the root of your siteThe root of your site is the main folder where your website files live. If your site is "example.com", the root is what you see when you visit "example.com/" — it's the top-level directory..
  3. Send notifications via HTTPHTTP (HyperText Transfer Protocol) is the standard method used by browsers and servers to communicate on the web. When IndexNow "sends an HTTP request", it means your site sends a message over the internet to the search engine's server. every time a page is added or updated.

IndexNow for Joomla

For Joomla users, there's a free component called Aimy IndexNow that integrates your website with the IndexNow protocol. It automatically sends URL updates to search engines every time content is added or modified, ensuring your site stays visible and up-to-date.

Compatible with Joomla! 3, 4, and 5, the plugin supports:

  • API key generation for request authentication.
  • Minimum submission interval settings.
  • Manual or automatic submissions.
  • Content exclusion rules to avoid unwanted URL submissions.

1. Download the Plugin

2. Install the Plugin

  • Log in to your Joomla backendThe backend (or admin panel) is the private area of your Joomla site where you manage content, plugins, and settings. You access it by adding "/administrator" to your site URL..
  • Go to Extensions > Manage > Install.
  • Upload the ZIP fileA ZIP file is a compressed archive that bundles multiple files into one. Joomla extensions are distributed as ZIP files — you upload the entire ZIP, and Joomla extracts and installs it automatically. you downloaded.
  • Click Upload & Install.

3. Configure Aimy IndexNow

  • Navigate to Extensions > Plugin Manager.
  • Search for Aimy IndexNow and click Edit.

Main configuration steps:

  1. Generate your API Key
    • Go to the API key section and follow the instructions to generate it via Bing Webmaster Tools.
  2. Set submission intervals
    • Define how often automatic notifications should be sent. A good default is 60 minutes — setting it too low may trigger rate limitingRate limiting means the server rejects your requests because you're sending too many in a short time. IndexNow returns error code 429 ("Too Many Requests") if you submit URLs too frequently..
  3. Enable auto submission
    • Send URLs automatically when content is updated.
  4. Exclude unwanted URLs
    • Apply filters to block specific content from being submitted.

4. Get Your API Key

  • Register with Bing Webmaster ToolsBing Webmaster Tools is a free service by Microsoft that lets you monitor how your website appears in Bing search results, submit URLs, check for errors, and manage your IndexNow API key.:

    1. Go to Bing Webmaster Tools.
    2. Log in or create a Microsoft account.
    3. Add your website in the Bing dashboard.
    4. Go to Settings > IndexNow to generate your key.
    5. Copy the key and add it to the plugin's settings in Joomla.

5. Test the Setup

Once the plugin is configured, you need to verify that the entire chain works — from Joomla all the way to the search engines. Here's exactly how to do it:

A) Create or edit a test article

In the Joomla backend, go to Content > Articles. Either create a new article (even a short one like "IndexNow Test") or open an existing article, make a small edit (add a word, fix a typo), and click Save. The plugin automatically sends a notification to indexnow.orgindexnow.org is the central endpoint that receives all IndexNow notifications. Once it gets your URL, it automatically shares it with all participating search engines (Bing, Yandex, and others) — you don't need to notify each one separately. upon saving.

B) Check the notification message in Joomla

After saving, look for a notification message at the top of your Joomla admin page. On Joomla 4 and 5, these messages are queued and appear as soon as you visit a section that triggers content pluginsContent plugins in Joomla are pieces of code that run when content is loaded or saved. Aimy IndexNow hooks into this system — so when you save an article, the plugin fires and sends the notification. — such as the Articles section (Content > Articles).

What you should see:

  • Success message: something like "URL https://yoursite.com/your-article submitted to indexnow.org" — this means everything worked.
  • Interval message: "Submission canceled — same URL submitted recently" — this means the minimum interval hasn't passed yet. This is normal, not an error.
  • Error message: indicates a problem — invalid API key, unreachable key file, network issue, etc.

Tip: If you set the Submission mode to "Ask" instead of "Automatic" in the plugin settings, Joomla will prompt you to confirm each submission manually — useful for testing.

C) Verify the API key file is accessible

Open your browser and navigate directly to your key file. For example, if your API key is a1b2c3d4e5f6, visit:

https://yoursite.com/a1b2c3d4e5f6.txt

You should see the key string displayed as plain text. If you get a 404 errorA 404 error means "Page Not Found". If you see this when visiting your API key file URL, it means the file is missing from your server's root directory or has a wrong filename. IndexNow won't work without it., the file is missing or misnamed — you'll need to re-upload it to the root directory of your website via FTPFTP (File Transfer Protocol) is a method to upload and download files to/from your web server. Tools like FileZilla or your hosting's File Manager let you connect to your server and place files in the right directory. or your hosting's File Manager.

D) Verify reception on Bing Webmaster Tools

  1. Log in to Bing Webmaster Tools and select your site.
  2. Use the URL Inspection tool: paste the URL of the article you just saved. If IndexNow worked, you should see a recent crawl date or a "Discovered" status.
  3. Check the IndexNow section under Reports & Data to see submission statistics and any errors.

Important: Submitting a URL via IndexNow does not guarantee instant indexation. It guarantees that the search engine is aware of the change — the actual crawl and indexation may take some time.

Understanding HTTP response codes

When IndexNow processes your submission, it returns a response codeAn HTTP response code is a number that a server sends back to indicate whether a request succeeded or failed. For example, 200 means "OK" (success), while 403 means "Forbidden" (access denied). that tells you what happened:

  • 200 OK — URL submitted successfully.
  • 400 Bad Request — The request format is invalid (check the URL structure).
  • 403 Forbidden — API key is not valid, or the key file was not found on your server.
  • 422 Unprocessable Entity — The URL doesn't match the domain associated with your key.
  • 429 Too Many Requests — You're sending too many submissions. Increase the minimum interval in the plugin settings.

6. Final Checks and Ongoing Monitoring

Testing once isn't enough — you need a regular monitoring routine to make sure IndexNow keeps working correctly over time. Plugins can break silently after Joomla updates, API keys can expire, and server configurations can change.

A) Review Joomla system logs

Go to System > System Logs (or System > System Information > Logs depending on your Joomla version). Look for any PHP errorsPHP is the programming language that Joomla runs on. PHP errors in the system logs may indicate that the plugin encountered a technical problem — such as failing to connect to the IndexNow server or a misconfigured setting. or warnings related to Aimy IndexNow. Common issues include: connection timeouts to indexnow.org (your hosting may block outgoing HTTP requests), API key errors, or permission problems.

B) Periodically check plugin settings

Navigate to Extensions > Plugins > Aimy IndexNow and verify that:

  • The plugin is still enabled — Joomla updates can sometimes disable plugins automatically.
  • The API key is still present and valid.
  • The minimum submission interval is set appropriately (60 minutes is a good baseline for most sites).

C) Monitor submissions in Bing Webmaster Tools

Log in to Bing Webmaster Tools at least every two weeks and check:

  • IndexNow / URL Submission section: review how many URLs were submitted and whether any errors occurred (look for 403, 422, or 429 codes).
  • URL Inspection: spot-check 2–3 recently updated URLs to confirm they were crawled after the notification.
  • Search Performance: observe whether newly published content appears faster in Bing results since enabling IndexNow.

D) Monthly maintenance checklist

Follow this simple routine once a month to keep everything running smoothly:

  1. Publish or update a test article → confirm the success notification appears in Joomla.
  2. Visit https://yoursite.com/your-api-key.txt in the browser → confirm the key file is still accessible.
  3. In Bing Webmaster Tools, inspect the test article URL → confirm a recent crawl date.
  4. Check Joomla system logs for any recurring errors.
  5. If you encounter persistent 403 or 422 errors, regenerate your API key in Bing Webmaster Tools and update it both in the plugin settings and in the .txt file on your server.

Vincenzo Caserta's Perspective

Vincenzo Caserta emphasizes the importance of adopting technologies like IndexNow to keep your website up-to-date in search engine results. This "push" approach to SEO ensures your site remains visible and competitive in a fast-paced digital world.

Useful Links