Description
Hi there, thanks for this library! It seems to work great so far.
One small issue I'm having is that I'd rather write code using some of the more ergonomic APIs that have been introduced into Node over the past few years. This includes async iteration support for readable streams, which has been available in Node experimentally since 10.0.0 and as stable since 11.14.0. (Incidentally, that means it's now available in all non-EOL versions of Node.)
Here's a short example of using feedparser with async iteration support:
import fetch from "node-fetch";
import Feedparser from "feedparser";
async function main() {
const res = await fetch("https://news.google.com/rss/search?q=whatever");
if (res.ok) {
const parser = new Feedparser({ addmeta: false });
res.body.pipe(parser);
for await (const item of parser) {
console.log(item.title);
}
}
}
main().then(() => { console.log("Done!"); });
Pretty nice! Unfortunately, this library's use of the userland readable streams implementation prevents this, since it doesn't seem to support async iteration. Trying to run the above sample will fail with an obscure error.
However, if I patch feedparser to require stream
instead of readable-stream
:
diff --git a/node_modules/feedparser/lib/feedparser/index.js b/node_modules/feedparser/lib/feedparser/index.js
index 916356f..71344d3 100644
--- a/node_modules/feedparser/lib/feedparser/index.js
+++ b/node_modules/feedparser/lib/feedparser/index.js
@@ -13,7 +13,7 @@ var sax = require('sax')
, addressparser = require('addressparser')
, indexOfObject = require('array-indexofobject')
, util = require('util')
- , TransformStream = require('readable-stream').Transform
+ , TransformStream = require('stream').Transform
, _ = require('../utils');
The above sample works fine!
Is readable-stream
being used to facilitate browser usage of this library? I think Webpack and Browserify already shim the streams module when bundling for browser environments, so it might not be necessary. Alternately, this library could maybe offer an alternate browser
entrypoint in package.json
(or maybe there's a polyfill package that already does this).
feedparser version: 2.2.10
Node version: 16.6.2