Geek, techie, skeptic, drummer, feminist.
30221 stories
·
7 followers

Web Feeds: Turn any website into an RSS feed

3 Comments and 6 Shares

Not every website has an RSS feed. Some never did. Some had one years ago and quietly removed it. And some sites have content that updates regularly but was never structured as a feed in the first place: job boards, product listings, event calendars, changelog pages. Until now, if a site didn’t offer RSS, you were out of luck.

Web Feeds is a new feature that creates RSS feeds from any website. Point it at a URL, and NewsBlur analyzes the page structure, identifies the repeating content patterns, and generates extraction rules that turn the page into a live feed. It works on news sites, blogs, job boards, product pages, or really anything with a list of items that changes over time.

This is a huge feature and has been requested for years. I’m so thrilled to finally be able to offer it in a way that I feel comfortable with. Other solutions including having you select story titles on a re-hosted version of the page, but it was clumsy and error-prone. This way, we use LLMs to figure out what the story titles are likely to be, present the variations to you, and then let you decide what’s right. So much better!

How it works

Open the Add + Discover Sites page and click the Web Feed tab. Paste a URL and click Analyze. NewsBlur fetches the page, strips out navigation and boilerplate, and analyzes the HTML structure. Within a few seconds, you’ll see multiple extraction variants, each representing a different content pattern found on the page.

Progress updates stream in real-time while the analysis runs. NewsBlur typically finds 3-5 different extraction patterns on a page. The first variant is usually the main content (article list, blog posts, product grid), but sometimes the page has multiple distinct sections worth subscribing to. Each variant shows a label, a description of what it captures, and a preview of 3 extracted stories so you can see exactly what you’d get.

Select the variant that matches what you want to follow, pick a folder, and subscribe. NewsBlur will re-fetch and re-extract the page on a regular schedule, just like any other feed.

Story hints

Sometimes the initial best guess isn’t what you’re looking for. Maybe the page has a blog section and a job listings section, and you want the jobs. Click the Refine button and type a hint like “I’m looking for the job postings.” NewsBlur re-analyzes the page with your hint in mind and reorders the variants to prioritize what you described.

What gets extracted

For each story, NewsBlur extracts whatever it can find: title, link, content snippet, image, author, and date. Not every field will be available on every site, and that’s fine. At minimum you’ll get titles and links. The extraction uses XPath expressions, which means it’s precise and consistent across page refreshes as long as the site’s HTML structure stays the same.

When things change

Websites redesign. HTML structures shift. When NewsBlur detects that the extraction rules have stopped working (after 3 consecutive failures), the feed is flagged as needing re-analysis. You’ll see a feed exception indicator, and you can re-analyze the page with one click to generate updated extraction rules.

Use cases

Some examples of sites that work well with Web Feeds:

  • Company blogs without RSS — Many corporate blogs dropped their RSS feeds years ago. Web Feeds brings them back.
  • Job boards — Track new postings on a company’s careers page.
  • Government sites — Follow press releases, meeting agendas, or public notices.
  • Changelog pages — Monitor when a tool or service ships updates.
  • Event listings — Keep tabs on upcoming concerts, conferences, or local events.
  • Product pages — Watch for new arrivals or restocks on stores that don’t offer feeds.

Availability

Web Feeds are available to Premium Archive and Premium Pro subscribers. The ongoing feed fetching and extraction runs on NewsBlur’s servers like any other feed.

If you have feedback or ideas for improvements, please share them on the NewsBlur forum.

Read the whole story
samuel
8 days ago
reply
One of the best new features ever. I say that but just wait until I launch the Daily Briefing and story clustering, both coming sooooooon... also I just finished AI prompt classifiers for text and for images, so that's also coming. Hoo boy, lots of good stuff. And Android redesign is nearly complete!
San Francisco
chrismorgan
8 days ago
The feature makes sense, but… could you please give it a different name? https://en.wikipedia.org/wiki/Web_feed
samuel
8 days ago
Web feed is a superset of RSS feed, so it seems quite appropriate
chrismorgan
8 days ago
This is specifically a feature to let you subscribe to sources that *don’t have* a web feed. The name “Web Feed” is accordingly very confusing.
ameel
2 hours ago
reply
Melbourne, Australia
Share this story
Delete
2 public comments
digitalink2008
8 days ago
reply
Samuel you absolute BAMF! This is an amazing feature!
jgbishop
8 days ago
reply
NewsBlur keeps getting better!
Raleigh, NC

Amy Grant - Every Heartbeat | The Song

1 Share
From: THESONGTV
Duration: 3:25
Views: 644

Amy Grant performs "Every Heartbeat" on The Song.

Watch more The Song videos: https://www.youtube.com/playlist?list=PLQiuzKPW8dR8INgvvx65xiiBoNLZzhz-z

Follow The Song:
Website: https://www.thesong.tv/
Instagram: https://www.instagram.com/thesongtv/?hl=en
Facebook: https://www.facebook.com/thesongtvofficial/
X: https://twitter.com/thesong_tv?lang=en

#TheSong #TheSongTV #AmyGrant #EveryHeartbeat

Read the whole story
ameel
3 hours ago
reply
Melbourne, Australia
Share this story
Delete

Domestic masculinity in media

1 Share
From: rebelliouspixels
Duration: 3:00
Views: 118,128

Ludo from High Potential is a rare positive example of domestic masculinity in media. Most of the time depictions of men doing chores or childcare is used as a visual gag. #highpotential #househusband #goofy #patriarchy #masculinity

Read the whole story
ameel
3 hours ago
reply
Melbourne, Australia
Share this story
Delete

MORE ART (for your walls)Signed Prints

1 Share


MORE ART (for your walls)

Read the whole story
ameel
4 hours ago
reply
Melbourne, Australia
Share this story
Delete

friends

1 Share

friends

Read the whole story
ameel
13 days ago
reply
Melbourne, Australia
Share this story
Delete

Add + Discover Sites: YouTube, Reddit, podcasts, newsletters, and thousands of feeds to explore

1 Comment and 2 Shares

NewsBlur has always been great at reading feeds. But finding new ones? That was mostly on you. The old “Add Site” dialog was a search box and not much else. If you already had a feed URL, it worked fine. If you were looking for something new to read, you were on your own.

The new Add + Discover Sites page changes that. It’s a full-page discovery experience with eight tabs covering YouTube channels, Reddit communities, podcasts, newsletters, Google News topics, trending sites, popular feeds, and of course the classic search-and-subscribe workflow. There are over 50,000 curated feeds to browse, all organized into dozens of categories and subcategories.

Eight ways to find feeds

The tab bar across the top gives you eight different lenses into the world of RSS:

  • Search — The classic search bar, now with semantic search and autocomplete. Type a topic or URL and get instant suggestions. Below the search results you’ll find trending feeds ranked by a hybrid algorithm that combines subscription velocity, read engagement, and subscriber counts.

  • Web Feed — Create RSS feeds from any website. This one gets its own blog post.

  • Popular Sites — Thousands of curated RSS feeds organized into categories like Technology, Science, News, and Business. Each category has subcategories for drilling down further.

  • YouTube — Over 2,000 verified YouTube channels converted to RSS feeds. Browse by category or search for specific channels. Subscribe and read YouTube in your feed reader the way it should be.

  • Reddit — Nearly 6,000 real subreddits across 47 categories. From r/programming to r/sourdough, you can subscribe to any subreddit as an RSS feed.

  • Newsletters — Newsletters from Substack, Medium, Ghost, Beehiiv, and other platforms. Platform pills let you filter by newsletter provider if you have a preference.

  • Podcasts — Popular podcasts organized by genre. Search for shows or browse the curated collection.

  • Google News — Eight preset topics (World, Business, Technology, Sports, and more) that create feeds from Google News. One click to subscribe.

Categories and subcategories

Most tabs are organized with a two-level taxonomy. Click a category pill at the top to filter, then drill into subcategories for more specific browsing. YouTube’s Technology category, for example, breaks down into Programming, AI & Machine Learning, Gadgets, and more.

The categories are consistent across tabs where it makes sense, so you can explore Technology feeds across YouTube, Reddit, Popular Sites, and Podcasts without having to rethink the navigation each time.

Grid view and list view

Every tab supports two viewing modes. Grid view shows feed cards with thumbnails, descriptions, subscriber counts, and freshness indicators. List view compresses things into a denser layout when you want to scan quickly.

A style popover in the top right lets you toggle between views. Your preference is saved per tab.

Try before you subscribe

Every feed card has a Try button that instantly fetches the feed and shows you the actual stories. No commitment, no subscribing. Just a quick look at what you’d get. If you like what you see, the subscribe button is right there with a folder picker.

A breadcrumb link at the top takes you back to where you were browsing when you’re done previewing.

The new Add Site popover

If you don’t need the full discovery page, the popover that appears when you click “+” in the sidebar has been redesigned too. It still has the quick URL input for when you have a feed address handy, but now it also shows freshness indicators and has buttons to jump into any of the discovery tabs.

The search tab uses Elasticsearch to find feeds by name with fuzzy matching. Type “cooking” and you’ll get cooking blogs, YouTube cooking channels, cooking subreddits, and cooking podcasts. It searches across all feed types, not just traditional RSS. If Elasticsearch doesn’t find anything, the search falls back to a database query so you’ll always get results.

Where all these feeds came from

Building the discovery page meant curating a lot of feeds. I wrote management commands to discover and verify channels, subreddits, podcasts, and newsletters from real sources. The collection includes over 2,000 YouTube channels, 6,600 subreddits, 7,300 newsletters, 32,000 podcasts, and 14,000 RSS feeds. Over 63,000 feeds in total, all real, verified, and categorized.

The Add + Discover Sites page is available now on the web for all users. If you have feedback or ideas for new categories, platforms, or features, please share them on the NewsBlur forum.

Read the whole story
ameel
17 days ago
reply
Melbourne, Australia
Share this story
Delete
1 public comment
jgbishop
17 days ago
reply
I've wanted this for so long!!!
Raleigh, NC
Next Page of Stories