dkamm/pr-quiz: A GitHub Action that uses AI to generate a quiz from your pull request

AI Agents are starting to write more code. How do we make sure we understand
what they’re writing?

PR Quiz is a GitHub Action that uses AI to generate a quiz based on a pull
request. It can help you, the human reviewer, test your understanding of your AI
Agent’s code. (And block you from deploying code you don’t understand!)

1. Make sure you have an OpenAI API Key and an ngrok auth token (free tier
   works).*
2. Add the OpenAI API Key and ngrok auth token as action secrets to your
   repository (settings -> secrets -> actions in the UI)
3. Add the following quiz.yml to your .github/workflows directory

# quiz.yml

name: PR Quiz

on:
  pull_request_review:
    types: [submitted]

permissions:
  contents: read
  pull-requests: read

jobs:
  quiz:
    name: PR Quiz
    runs-on: ubuntu-latest
    environment: your-environment # TODO: change this to your actual environment
    # Only trigger on approvals to save tokens
    if: github.event.review.state == 'approved'

    steps:
      - name: Checkout
        id: checkout
        uses: actions/checkout@v4

      - name: Serve Quiz
        id: serve-quiz
        uses: dkamm/pr-quiz@v0.1.0
        with:
          github-token: ${{ secrets.GITHUB_TOKEN }}
          openai-api-key: ${{ secrets.OPENAI_API_KEY }}
          ngrok-authtoken: ${{ secrets.NGROK_AUTHTOKEN }}

*The PR Quiz action creates a temporary webserver inside the GitHub Actions
runner and uses ngrok to create a public tunnel to it

Because this action runs a temporary webserver inside the GitHub Actions runner,
your code isn’t sent to any third party other than the model provider (OpenAI).
This action can be easily modified to work with self-hosted models as well.

Keep your files stored safely and securely with the SanDisk 2TB Extreme Portable SSD. With over 69,505 ratings and an impressive 4.6 out of 5 stars, this product has been purchased over 8K+ times in the past month. At only $129.99, this Amazon’s Choice product is a must-have for secure file storage.

Help keep private content private with the included password protection featuring 256-bit AES hardware encryption. Order now for just $129.99 on Amazon!

Help Power Techcratic’s Future – Scan To Support

If Techcratic’s content and insights have helped you, consider giving back by supporting the platform with crypto. Every contribution makes a difference, whether it’s for high-quality content, server maintenance, or future updates. Techcratic is constantly evolving, and your support helps drive that progress.

As a solo operator who wears all the hats, creating content, managing the tech, and running the site, your support allows me to stay focused on delivering valuable resources. Your support keeps everything running smoothly and enables me to continue creating the content you love. I’m deeply grateful for your support, it truly means the world to me! Thank you!