4 commits

Author	SHA1	Message	Date
Frédéric Guillot	6d58052504	fix(readability): do not remove elements within code blocks ... `<span class="hljs-comment"># exit 1</span>` will match the `unlikelyCandidatesRegexp` because it contains the `comment` string.	2025-06-19 21:03:53 -07:00
jvoisin	2df59b4865	Refactor internal/reader/readability/testdata ... - Use chained strings.Contains instead of a regex for blacklistCandidatesRegexp, as this is a bit faster - Simplify a Find.Each.Remove to Find.Remove - Don't concatenate id and class for removeUnlikelyCandidates, as it makes no sense to match on overlaps. It might also marginally improve performances, as regex now have to run on two strings separately, instead of both. - Add a small benchmark	2024-12-15 20:52:32 -08:00
Julien Voisin	6ad5ad0bb2	refactor(readability): various improvements and optimizations ... - Replace a completely overkill regex - Use `.Remove()` instead of a hand-rolled loop - Use a strings.Builder instead of a bytes.NewBufferString - Replace a call to Fprintf with string concatenation, as the latter are much faster - Remove a superfluous cast - Delay some computations - Add some tests	2024-12-12 20:41:56 -08:00
Frédéric Guillot	29387f2d60	feat: implement base element handling in content scraper	2024-07-25 20:36:56 -07:00