Site Map - skip to main content

Hacker Public Radio

Your ideas, projects, opinions - podcasted.

New episodes Monday through Friday.

hpr3637 :: HPR feed to Sqlite

First step in creating a static copy of HPR

<< First, < Previous, Latest >>

Hosted by norrist on Tuesday 2022-07-12 is flagged as Clean and is released under a CC-BY-SA license.
Tags: python, rss, sqlite.

Listen in ogg, spx, or mp3 format. | Comments (1)

  • Mailing list discussion - Source Code for the HPR website
    • What are the best ways to reproduce the HPR site using a static site generator.
    • I would like the DB to be made public, but I understand why that may not be possible

One interesting thing I read during the discussion is Ken said Every thing needed to recreate an HPR site is in the feed

  • Challenge accepted
    • A lot of my toy projects have been around RSS and podcasts
    • I am working on a Episode describing a project I did looking for podcasts that have podfaded.
    • I starting thinking about what data is in the feed and thinking through a process for using the RSS data to recreate the HPR site
  • Project
  • DATA pulled directly from feed
    • explicit

    • title

    • author_name

    • author_email

    • link

    • description

    • summary - I think this is the same as description

    • pubdate

    • enclosures

    • Episode ID - extracted from title - HPR2341

    • feedparser and peewee

    • full feed to SQLite specs

      • 40 Seconds on My Machine
      • 20M hpr.sqlite
  • Notably Missing from the RSS feeds
    • Episode Series
    • Episode Tags
  • Next steps
    • markdown from db info
      • Main page
      • Corespondent pages
      • Episode pages
      • comments from comments feed
    • Manually build other markdown for static pages
    • about, contributing, ...
    • Static site generator
    • I don't think the tags are in the feed data
git clone
cd hprfeed2db/
python3 -m venv venv
source venv/bin/activate
pip install feedparser peewee
sqlite3 hpr.sqlite "select count(*) from episode"

Show Transcript

Automatically generated using whisper

whisper --model tiny --language en hpr3637.wav

<< First, < Previous, Latest >>


Subscribe to the comments RSS feed.

Comment #1 posted on 2022-07-20T13:18:59Z by Ken Fallon

Daily Database Dump in SQL Format

<< First, < Previous, Latest >>

Leave Comment

Note to Verbose Commenters
If you can't fit everything you want to say in the comment below then you really should record a response show instead.

Note to Spammers
All comments are moderated. All links are checked by humans. We strip out all html. Feel free to record a show about yourself, or your industry, or any other topic we may find interesting. We also check shows for spam :).

Provide feedback
Your Name/Handle:
Anti Spam Question: What does the P in HPR stand for ?
Are you a spammer →
Who hosted this show →
What does HPR mean to you ?