Scrape Hacker News Articles

This task grabs the latest Hacker News articles (titles and links) from the first 4 pages and puts them into a JSON array.
1
Browser Control

Go

url
https://news.ycom...
waitUntil
networkidle
2
Data Extraction

Save Structured Data

data
title a Text --- ...
helper
td[class*="title"]
3
Interaction

Click

helper
a[rel="next"][cla...
4
Interaction

Go To Step

step
2
repeat
3
Example Output
{
  "go": {
    "status": 200,
    "headers": {
      "server": "nginx",
      "date": "Wed, 29 Mar 2023 07:07:34 GMT",
      "content-type": "text/html; charset=utf-8",
      "transfer-encoding": "chunked",
      "connection": "keep-alive",
      "vary": "Accept-Encoding",
      "cache-control": "private; max-age=0",
      "x-frame-options": "DENY",
      "x-content-type-options": "nosniff",
      "x-xss-protection": "1; mode=block",
      "referrer-policy": "origin",
      "strict-transport-security": "max-age=31556900",
      "content-security-policy": "default-src 'self'; script-src 'self' 'unsafe-inline' https://www.google.com/recaptcha/ https://www.gstatic.com/recaptcha/ https://cdnjs.cloudflare.com/; frame-src 'self' https://www.google.com/recaptcha/; style-src 'self' 'unsafe-inline'; img-src 'self' https://account.ycombinator.com; frame-ancestors 'self'",
      "content-encoding": "gzip"
    }
  },
  "save_structured_data": [
    {
      "title": "Text2Video-Zero Code and Weights Released by Picsart AI Research (12G VRAM)",
      "link": "https://github.com/Picsart-AI-Research/Text2Video-Zero"
    },
    {
      "title": "Bicycle",
      "link": "https://ciechanow.ski/bicycle/"
    },
    {
      "title": "Generative AI is good at cooperating with people and bad at full automation",
      "link": "https://skybrian.substack.com/p/generative-ai-is-good-at-cooperating"
    },
    {
      "title": "Writing a Profiler in 240 lines of pure Java",
      "link": "https://mostlynerdless.de/blog/2023/03/27/writing-a-profiler-in-240-lines-of-pure-java/"
    },
    {
      "title": "Binance sees $2B in outflows as troubles compound",
      "link": "https://www.wsj.com/articles/binance-sees-2-billion-in-outflows-as-troubles-compound-9a136e21"
    },
    {
      "title": "Brainstorm Questions Not Ideas",
      "link": "https://www.muledesign.com/blog/brainstorm-questions"
    },
    {
      "title": "Show HN: Customizable, embeddable Chat GPT based on your own documents",
      "link": "https://libraria.dev/"
    },
    {
      "title": "Establishing a UART Root Connection to a TP-Link Wireless Router",
      "link": "https://staging.rickconsole.com/posts/hardware-hacking-tp-link/"
    },
    {
      "title": "Open Flamingo – open framework to train multimodal LLMs",
      "link": "https://laion.ai/blog/open-flamingo/"
    },
    {
      "title": "Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa",
      "link": "https://github.com/nomic-ai/gpt4all"
    },
    {
      "title": "The EV Transition Is Harder Than Anyone Thinks",
      "link": "https://spectrum.ieee.org/the-ev-transition-explained-2659602311"
    },
    {
      "title": "Show HN: GPT Calculator – Calculate the token count and cost of your GPT Prompt",
      "link": "https://www.gptcalculator.xyz/"
    },
    {
      "title": "Disney Eliminates Its Metaverse Division",
      "link": "https://www.wsj.com/articles/disney-eliminates-its-metaverse-division-as-part-of-companys-layoffs-plan-94b03650"
    },
    {
      "title": "Infinite Mac: Infinitemac.org",
      "link": "https://blog.persistent.info/2023/03/infinitemac-dot-org.html"
    },
    {
      "title": "Scientists discover why aspirin works so well",
      "link": "https://www.eurekalert.org/news-releases/983050?"
    },
    {
      "title": "LLMs and GPT: Some of my favorite learning materials",
      "link": "https://gist.github.com/rain-1/eebd5e5eb2784feecf450324e3341c8d"
    },
    {
      "title": "NXP LA9310: A new platform for SDR and the 10-year-old AD9361 RF Transceiver",
      "link": "https://rfnm.io"
    },
    {
      "title": "A Simple Parametric Model of Plain-Knit Yarns [pdf]",
      "link": "http://www.cs.cmu.edu/~kmcrane/Projects/Other/YarnCurve.pdf"
    },
    {
      "title": "TaxyAI: Open-source browser automation with GPT-4",
      "link": "https://github.com/TaxyAI/browser-extension"
    },
    {
      "title": "Launch HN: Metal (YC W23) – Embeddings as a Service",
      "link": "item?id=35341514"
    },
    {
      "title": "UK sets up fake booter sites to muddy DDoS market",
      "link": "https://krebsonsecurity.com/2023/03/uk-sets-up-fake-booter-sites-to-muddy-ddos-market/"
    },
    {
      "title": "$39 Cooler Master case turns your old Framework Laptop parts into a tiny PC",
      "link": "https://www.theverge.com/2023/3/23/23652939/framework-cooler-master-sff-pc-case"
    },
    {
      "title": "Medieval Arabic surgeon Ibn al Quff's account on surgical pain relief",
      "link": "https://journals.lww.com/anar/fulltext/2010/04010/historical_essay__an_arabic_surgeon,_ibn_al_quff_s.3.aspx"
    },
    {
      "title": "My4TH – A minimalistic FORTH computer with discrete CPU",
      "link": "http://mynor.org/my4th"
    },
    {
      "title": "Linguistics and Programming Languages (2006)",
      "link": "https://250bpm.com/blog:95/"
    },
    {
      "title": "SafeBeat (YC S21) Is Hiring",
      "link": "https://www.ycombinator.com/companies/safebeat/jobs/jeOKzr2-product-manager-advisor"
    },
    {
      "title": "WiFi protocol flaw allows attackers to hijack network traffic",
      "link": "https://www.bleepingcomputer.com/news/security/wifi-protocol-flaw-allows-attackers-to-hijack-network-traffic/"
    },
    {
      "title": "Interaction Nets, Combinators, and Calculus – HVM",
      "link": "https://zicklag.github.io/blog/interaction-nets-combinators-calculus/"
    },
    {
      "title": "NSA Ghidra software reverse engineering framework",
      "link": "https://github.com/NationalSecurityAgency/ghidra"
    },
    {
      "title": "Cerebras-GPT: A Family of Open, Compute-Efficient, Large Language Models",
      "link": "https://www.cerebras.net/blog/cerebras-gpt-a-family-of-open-compute-efficient-large-language-models/"
    },
    {
      "title": "More",
      "link": "?p=2"
    },
    {
      "title": "New health insurance “transparency data” looks suspiciously wrong",
      "link": "https://www.dolthub.com/blog/2023-03-23-illusion-of-transparency/"
    },
    {
      "title": "Introduction to Autoencoders",
      "link": "https://www.pinecone.io/learn/autoencoders/"
    },
    {
      "title": "On Writing Better Error Messages",
      "link": "https://onlineornot.com/write-better-error-messages"
    },
    {
      "title": "EU Commission doesn't understand what's written in its own chat control bill",
      "link": "https://mullvad.net/en/blog/2023/3/28/the-european-commission-does-not-understand-what-is-written-in-its-own-chat-control-bill/"
    },
    {
      "title": "Intel 80386 CPU Information",
      "link": "https://www.pcjs.org/documents/manuals/intel/80386/"
    },
    {
      "title": "Tectonic – A modern, complete, self-contained Tex engine with Unicode support",
      "link": "https://tectonic-typesetting.github.io/en-US/"
    },
    {
      "title": "Apple Music Classical",
      "link": "https://learn.applemusic.apple/apple-music-classical"
    },
    {
      "title": "Is Babylon 5 secretly the most influential TV show of the past 25 years? (2021)",
      "link": "https://www.techradar.com/news/is-babylon-5-secretly-the-most-influential-tv-show-of-the-past-25-years"
    },
    {
      "title": "Show HN: A fully open-source (Apache 2.0)implementation of llama",
      "link": "https://github.com/Lightning-AI/lit-llama"
    },
    {
      "title": "X86.fr – Doc TB's R&D Lab",
      "link": "https://x86.fr/"
    },
    {
      "title": "Apple passwords deserve an app",
      "link": "https://cabel.com/2023/03/27/apple-passwords-deserve-an-app/"
    },
    {
      "title": "Martin Frobenius Ledermüller’s Microscopic Delights (1759–63)",
      "link": "https://publicdomainreview.org/collection/microscopic-delights"
    },
    {
      "title": "U.S. FDIC tells Signature crypto clients to close accounts by April 5",
      "link": "https://www.reuters.com/markets/us/us-fdic-tells-signature-banks-crypto-clients-close-accounts-by-april-5-2023-03-28/"
    },
    {
      "title": "The Shaman’s Secrets",
      "link": "https://www.archaeology.org/issues/501-2303/features/11195-germany-mesolithic-shaman-burial"
    },
    {
      "title": "How to create a private ChatGPT with your own data",
      "link": "https://medium.com/@imicknl/how-to-create-a-private-chatgpt-with-your-own-data-15754e6378a1"
    },
    {
      "title": "HuggingFace and Open Source AI Meetup in SFO Mar 31st",
      "link": "https://twitter.com/BrigitteTousi/status/1640771873985142786"
    },
    {
      "title": "The true power of regular expressions (2012)",
      "link": "https://www.npopov.com/2012/06/15/The-true-power-of-regular-expressions.html"
    },
    {
      "title": "Pilot plant uses fruit peels to break down metal waste in lithium batteries",
      "link": "https://www.channelnewsasia.com/singapore/recycling-plant-fruit-peels-break-down-metal-waste-lithium-batteries-3381616"
    },
    {
      "title": "William Wulf, computer pioneer who opened way for internet, dies at 83",
      "link": "https://www.washingtonpost.com/obituaries/2023/03/28/william-wulf-internet-computers-dies/"
    },
    {
      "title": "Windows 11 KB5023778 update adds promotions to the Start menu",
      "link": "https://www.bleepingcomputer.com/news/microsoft/windows-11-kb5023778-update-adds-promotions-to-the-start-menu/"
    },
    {
      "title": "Iceland long term visa for remote workers",
      "link": "https://island.is/en/get-long-term-visa-for-remote-workers"
    },
    {
      "title": "I use Google Bard to rewrite articles behind a paywall so I can read them",
      "link": "https://old.reddit.com/r/ChatGPT/comments/12504zg/it_begins_browsing_enabled/"
    },
    {
      "title": "Now You Have Three Problems – A Story about Parsing",
      "link": "https://github.com/dabeaz/blog/blob/main/2023/three-problems.md"
    },
    {
      "title": "Espresso and Open Source Hardware?",
      "link": "https://sohl.substack.com/p/espresso-and-open-source-hardware"
    },
    {
      "title": "Apple introduces Apple Pay Later",
      "link": "https://www.apple.com/newsroom/2023/03/apple-introduces-apple-pay-later/"
    },
    {
      "title": "A non-federated decentralized social protocol based on Git",
      "link": "https://github.com/social4git/social4git"
    },
    {
      "title": "Show HN: An all-in-one app designed for deep work and to build atomic habits",
      "link": "https://www.floutwork.com"
    },
    {
      "title": "Show HN: I built developer tooling for the Airtable API that I needed",
      "link": "https://airwalker.io"
    },
    {
      "title": "JWST gets best view yet of planet in hotly pursued star system",
      "link": "https://www.nature.com/articles/d41586-023-00876-7"
    },
    {
      "title": "A student's guide to startups (2006)",
      "link": "http://www.paulgraham.com/mit.html"
    },
    {
      "title": "More",
      "link": "?p=3"
    },
    {
      "title": "Always use Zoom in a browser. Avoid the app (2020)",
      "link": "https://www.forbes.com/sites/kateoflahertyuk/2020/04/29/zoom-security-tip-avoid-the-app-and-do-this-instead-heres-why/"
    },
    {
      "title": "OpenPGP master key on Nitrokey Start",
      "link": "https://blog.josefsson.org/2023/03/27/openpgp-master-key-on-nitrokey-start/"
    },
    {
      "title": "Wang Word Processor – The Giant Killer",
      "link": "https://computeradsfromthepast.substack.com/p/wang-word-processor"
    },
    {
      "title": "Nuenv: An experimental Nushell builder for Nix packages",
      "link": "https://determinate.systems/posts/nuenv"
    },
    {
      "title": "California's 'Phantom Lake' Returns",
      "link": "https://www.latimes.com/california/story/2023-03-28/phantom-tulare-lake-returns-with-a-vengeance"
    },
    {
      "title": "The strange case of ICMP Type 69 on Linux",
      "link": "https://blog.benjojo.co.uk/post/linux-icmp-type-69"
    },
    {
      "title": "Britain Is Broken",
      "link": "https://www.thetimes.co.uk/article/britain-is-broken-heres-how-we-can-mend-it-lkbmc8rvt"
    },
    {
      "title": "Rust Is a Scalable Language",
      "link": "https://matklad.github.io/2023/03/28/rust-is-a-scalable-language.html"
    },
    {
      "title": "Open Sourcing Cody – Sourcegraph's AI-enabled editor assistant",
      "link": "https://about.sourcegraph.com/blog/open-sourcing-cody"
    },
    {
      "title": "AI startup Pinecone valued at $700M",
      "link": "https://www.businessinsider.com/chroma-weaviate-pinecone-raise-funding-a16z-index-vector-database-ai-2023-3"
    },
    {
      "title": "Android app from China executed 0-day exploit on millions of devices",
      "link": "https://arstechnica.com/information-technology/2023/03/android-app-from-china-executed-0-day-exploit-on-millions-of-devices/"
    },
    {
      "title": "Fugue: A unified interface for distributed computing",
      "link": "https://github.com/fugue-project/fugue"
    },
    {
      "title": "Procedural 3D mesh generation in a 64kB intro",
      "link": "https://www.ctrl-alt-test.fr/2023/procedural-3d-mesh-generation-in-a-64kb-intro/"
    },
    {
      "title": "Push notifications are now supported cross-browser",
      "link": "https://web.dev/push-notifications-in-all-modern-browsers/"
    },
    {
      "title": "From Laptop to Lambda: Outsourcing Jobs to Thousands of Functional Containers [pdf]",
      "link": "https://www.usenix.org/system/files/atc19-fouladi.pdf"
    },
    {
      "title": "Senate Bill to Ban TikTok",
      "link": "https://www.congress.gov/bill/118th-congress/senate-bill/686/text?s=1&r=15"
    },
    {
      "title": "Launch HN: Play.ht (YC W23) – Generate and clone voices from 20 seconds of audio",
      "link": "item?id=35328698"
    },
    {
      "title": "Clearview AI used nearly 1M times by US police, it tells the BBC",
      "link": "https://www.bbc.com/news/technology-65057011"
    },
    {
      "title": "Can you buy the same ticket at a lower price if you buy it from another country?",
      "link": "https://travel.stackexchange.com/questions/180321/can-you-buy-the-same-ticket-with-a-lower-price-if-you-buy-it-from-another-countr"
    },
    {
      "title": "China reports human case of H3N8 bird flu",
      "link": "https://bnonews.com/index.php/2023/03/china-reports-human-case-of-h3n8-bird-flu/"
    },
    {
      "title": "Quicker serverless Postgres connections",
      "link": "https://neon.tech/blog/quicker-serverless-postgres"
    },
    {
      "title": "Your \"simulation\" might not need state",
      "link": "https://www.onsclom.net/posts/simulator-state"
    },
    {
      "title": "OLED producer JOLED files for bankruptcy",
      "link": "https://www.anandtech.com/show/18796/joled-files-for-bankruptcy-set-to-transfer-oled-ip-to-jdi-and-close-down-two-plants"
    },
    {
      "title": "Show HN: Regex.ai – AI-powered regular expression generator",
      "link": "https://regex.ai/"
    },
    {
      "title": "Turmoil at ‘Chief’ raises the question: is empowering corporate women enough?",
      "link": "https://www.nytimes.com/2023/03/28/business/chief-corporate-women-networking-club.html"
    },
    {
      "title": "Wavelength",
      "link": "https://daringfireball.net/2023/03/wavelength"
    },
    {
      "title": "PayPal has restricted our account after we invoiced a key containing “ALEP”",
      "link": "https://twitter.com/littlesnitch/status/1640436716895870985"
    },
    {
      "title": "How to Polis, 101, Part IIb: Archons",
      "link": "https://acoup.blog/2023/03/24/collections-how-to-polis-101-part-iib-archons/"
    },
    {
      "title": "Random Fuzzy Thoughts",
      "link": "https://tigerbeetle.com/blog/2023-03-28-random-fuzzy-thoughts/"
    },
    {
      "title": "What We Still Don’t Know About How A.I. Is Trained",
      "link": "https://www.newyorker.com/news/daily-comment/what-we-still-dont-know-about-how-ai-is-trained"
    },
    {
      "title": "More",
      "link": "?p=4"
    },
    {
      "title": "You Are You. We Live Here. This Is Now",
      "link": "https://freddiedeboer.substack.com/p/you-are-you-we-live-here-this-is"
    },
    {
      "title": "Higher-Order Virtual Machine (HVM)",
      "link": "https://github.com/HigherOrderCO/HVM"
    },
    {
      "title": "Locally run a ChatGPT-style LLM Trained from 800k GPT-3.5-Turbo Generations",
      "link": "https://twitter.com/andriy_mulyar/status/1640836003194630144"
    },
    {
      "title": "Geothermal Power, Cheap and Clean, Could Help Run Japan. So Why Doesn’t It?",
      "link": "https://www.nytimes.com/2023/03/22/climate/japan-hot-springs-geothermal-energy.html"
    },
    {
      "title": "A brief history of APFS (2022)",
      "link": "https://eclecticlight.co/2022/04/01/a-brief-history-of-apfs-in-honour-of-its-fifth-birthday/"
    },
    {
      "title": "Microsoft's Software Is Malware",
      "link": "https://www.gnu.org/proprietary/malware-microsoft.en.html"
    },
    {
      "title": "CFTC sues Binance and CEO Changpeng Zhao [pdf]",
      "link": "https://www.docdroid.net/60YAbCz/cftc-binance-pdf"
    },
    {
      "title": "Musk is remaking Twitter into a climate denier sanctuary",
      "link": "https://ketanjoshi.co/2023/03/28/musk-is-remaking-twitter-into-a-climate-denier-sanctuary/"
    },
    {
      "title": "An ancient Indian Buddhist monk buried in Athens",
      "link": "https://greekreporter.com/2023/03/20/ancient-indian-buddhist-monk-athens/"
    },
    {
      "title": "One of the Luckiest Lightning Strikes Ever Recorded",
      "link": "https://www.nytimes.com/2023/03/28/science/lightning-rod-video.html"
    },
    {
      "title": "Steam will drop support for Windows 7 and Windows 8 on January 1, 2024",
      "link": "https://www.engadget.com/steam-will-drop-support-for-windows-7-and-windows-8-on-january-1st-2024-152437694.html"
    },
    {
      "title": "Alibaba to split into six separate groups",
      "link": "https://www.wsj.com/articles/alibaba-to-split-into-six-separate-groups-in-biggest-shake-up-9ce2201f"
    },
    {
      "title": "The FBI Has Been Buying Bulk Internet Data from This Florida Company",
      "link": "https://gizmodo.com/team-cymru-fbi-data-collection-internet-surveillance-to-1850269719"
    },
    {
      "title": "Amazon starts flagging frequently returned products that you maybe shouldn’t buy",
      "link": "https://www.theverge.com/2023/3/28/23659868/amazon-returns-warning-product-reviews-tag-feature"
    },
    {
      "title": "GitHub India's entire Engineering team is fired",
      "link": "https://twitter.com/GergelyOrosz/status/1640585325192912898"
    },
    {
      "title": "The TikTok ban is a betrayal of the open internet",
      "link": "https://www.theverge.com/23653141/tiktok-ban-bytedance-congress-hearing-first-amendment-open-internet"
    },
    {
      "title": "Common Rifles Firing Same Ammo to Arm Finnish, Swedish Forces",
      "link": "https://www.thedrive.com/the-war-zone/common-rifles-firing-same-ammo-to-arm-finnish-swedish-forces"
    },
    {
      "title": "Guardian owner apologises for founders’ links to transatlantic slavery",
      "link": "https://www.theguardian.com/news/2023/mar/28/guardian-owner-apologises-founders-transatlantic-slavery-scott-trust"
    },
    {
      "title": "Trigonometric Functions in CSS",
      "link": "https://web.dev/css-trig-functions/"
    },
    {
      "title": "The perils of polishing old Fortran libraries",
      "link": "https://fortran-lang.discourse.group/t/the-perils-of-polishing-long/5444"
    },
    {
      "title": "Tweet replies no longer show who users are replying to",
      "link": "https://www.theverge.com/2023/3/28/23660291/twitter-replies-update-confusing"
    },
    {
      "title": "Hobbyist builds ChatGPT client for MS-DOS running on a 4.77 MHz IBM PC from 1981",
      "link": "https://arstechnica.com/information-technology/2023/03/retro-chatbot-chatgpt-comes-to-ms-dos-with-new-ai-client/"
    },
    {
      "title": "Ask HN: Successful one-person online businesses?",
      "link": "item?id=35333088"
    },
    {
      "title": "I made $3k in 16 attempts to launch my SaaS",
      "link": "https://www.indiehackers.com/post/i-made-3-000-in-16-attempts-to-launch-my-saas-06ab0a9f2a"
    },
    {
      "title": "ChatGPT robs students of motivation to write and think for themselves",
      "link": "https://theconversation.com/how-chatgpt-robs-students-of-motivation-to-write-and-think-for-themselves-197875"
    },
    {
      "title": "When Student Loan Payments Resume, Households Will Feel the Pinch",
      "link": "https://www.bloomberg.com/news/articles/2023-03-27/when-do-student-loan-payments-resume-restart-could-strain-household-budgets"
    },
    {
      "title": "Windows needs to stop showing tabloid news",
      "link": "https://www.tomshardware.com/news/windows-keeps-feeding-tabloid-news"
    },
    {
      "title": "How much money do we think Substack lost last year?",
      "link": "https://www.theverge.com/2023/3/28/23660473/substack-retail-investors-revenue-profit"
    },
    {
      "title": "Kubernetes is hard",
      "link": "https://rcwz.pl/2023-03-26-kubernetes-is-hard/"
    },
    {
      "title": "Defaulting on Single Page Applications",
      "link": "https://www.zachleat.com/web/single-page-applications/"
    },
    {
      "title": "More",
      "link": "?p=5"
    }
  ]
}

Integrate with Zapier or our REST API

Use This Task