New example for onboarding people + template for generating pddrc file #243

Frostday · 2026-01-02T19:31:36Z

Issue - #135 and #244

Frostday · 2026-01-03T03:24:03Z

Added the pddrc generation template (works based on the architecture json file)

Frostday · 2026-01-04T05:51:17Z

Some screenshots of the new example working:

CLI:

Streamlit UI:

jamesdlevine · 2026-01-05T09:18:05Z

Some initial quick thoughts (without hands-on with the example):

looks great as an example that will help people get up to speed with a substantial project
the prompts look well formed
maybe add requirements.txt for prereq packages?
it's also valuable for actual everyday use, so why not also:
- generate a Makefile which can handle the build & help development
- ensure the built example is itself installable with pip -e .
- give it a simple commandline frontend that can initiate any of parts (cli, backend, frontend)

Frostday · 2026-01-05T22:52:15Z

Thanks for the suggestions, James! I’ll try to implement these.

Copilot

Pull request overview

This PR introduces a comprehensive template system for the PDD (Prompt Driven Development) linter project, providing both an example onboarding workflow and a generic template for generating .pddrc configuration files. The additions enhance the developer experience by providing clear documentation patterns and automated configuration generation capabilities.

Key Changes:

Added generic .pddrc generation template to help projects adopt PDD practices
Introduced extensive test suite for the prompts_linter example application
Added core implementation files for the linter (rules, models, pipeline, report, llm, helpers, fix modules)
Created CLI and frontend interfaces for the linter application

Reviewed changes

Copilot reviewed 49 out of 49 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
pdd/templates/generic/generate_pddrc_YAML.prompt	Template for generating PDD configuration files from architecture.json
examples/prompts_linter/tests/*.py	Comprehensive test suite covering models, rules, pipeline, report, llm, helpers, fix, cli, and frontend
examples/prompts_linter/src/utils/*.py	Core utility modules implementing linting logic, LLM integration, models, and reporting
examples/prompts_linter/src/cli/cli.py	Command-line interface implementation
examples/prompts_linter/src/frontend/frontend_streamlit.py	Streamlit web interface
examples/prompts_linter/src/backend/backend_api.py	FastAPI backend service
examples/prompts_linter/prompts/*.prompt	Prompt definitions for generating each module

Comments suppressed due to low confidence (1)

examples/prompts_linter/src/utils/llm.py:1

The key "gemini" should be "google" to match the provider name used in get_provider_and_model function (lines 96-105) where it checks for "google" and references DEFAULT_MODELS["google"].

import os

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

examples/prompts_linter/tests/test_llm.py

examples/prompts_linter/tests/test_helpers.py

examples/prompts_linter/src/cli/cli.py

gltanaka

nice job!!
The prompts can be more compact but this might be a more of a function of the generate prompt template needing to be improved

examples/prompts_linter/project_dependencies.csv

gltanaka · 2026-01-07T17:25:21Z

examples/prompts_linter/prompts/cli_python.prompt

+You are an expert Python developer specializing in CLI tools using Typer and Rich. Your task is to implement the Command Line Interface (CLI) for the PDD Prompt Linter. This module, located at `src/cli/cli.py`, serves as the primary entry point for users interacting with the tool via the terminal. It is responsible for parsing arguments, configuring the runtime environment based on flags, invoking the central pipeline orchestrator, rendering the final report to the user, and handling fixed prompt output.
+
+Requirements
+1.  **Argument Parsing**: Use `Typer` to define the CLI application. The main command must accept a mandatory `PROMPT_FILE` argument (path to the file to lint).


maybe including the spec would have made the list of args unnecessary and prompt more compact?

It would have increased the tokens, so decided not to include it for now - should the PDD prompt generation template have included the spec automatically? Or can it only include files from prompts, contexts/examples, code, and tests?

examples/prompts_linter/prompts/fix_python.prompt

gltanaka · 2026-01-07T17:28:35Z

examples/prompts_linter/prompts/fix_python.prompt

@@ -0,0 +1,108 @@
+<prompt>
+You are an expert Python developer architecting the `src/utils/fix.py` module for the PDD Prompt Linter. This module is the remediation engine responsible for transforming an original prompt text into a compliant version based on the analysis provided in a `Report` object. It operates in two modes: applying specific text replacements suggested by the LLM (patching) and enforcing structural integrity when critical PDD elements are missing (scaffolding).


a preamble might eliminate redundancies between prompts

A preamble generated by PDD? - could be a new template in the future maybe?

Frostday · 2026-01-08T01:23:53Z

Updates:

Fixed the issue in pddrc generation
Added requirements.txt and Makefile in the example
Fixed project_dependencies.csv
Fixed some other bugs too

Note: Fixing the project dependency bug improved both project generation time and output quality

gltanaka · 2026-01-08T02:04:57Z

thanks for your, can you address the copilot comments?

Copilot

Pull request overview

Copilot reviewed 52 out of 52 changed files in this pull request and generated no new comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Frostday · 2026-01-08T02:17:35Z

Addressed the comments

jamesdlevine · 2026-01-08T20:04:08Z

I'm unable to file an issue against your fork so I'll comment bugs here...

The requirements.txt includes a clone of your personal pdd fork. That should not be a dependency (& also contradicts the installation steps in the README.) Like this-

-e git+https://github.com/Frostday/pdd.git@8df53aa2da1bc000832ad8038c2c092d99135bf1#egg=pdd_cli

jamesdlevine · 2026-01-08T20:11:24Z

Bug: linter cli exits with error and warning.

pwd

/home/james/dhrub-example/pdd/examples/prompts_linter

pdd --version

pdd, version 0.0.105

cat /etc/issue

Ubuntu 24.04.3 LTS \n \l

python -m src.cli.cli prompts/backend_api_python.prompt

Unexpected error during pipeline execution: 1 validation error for Issue
rule_id
String should have at least 2 characters
For further information visit https://errors.pydantic.dev/2.11/v/string_too_short
/home/james/miniconda3/envs/pdd-released/lib/python3.12/site-packages/pydantic/main.py:463: UserWarning: Pydantic serializer warnings:
PydanticSerializationUnexpectedValue(Expected 10 fields but got 6: Expected Message - serialized value may not be as expected [input_value=Message(content='{\n "gu...: None}, annotations=[]), input_type=Message])
PydanticSerializationUnexpectedValue(Expected StreamingChoices - serialized value may not be as expected [input_value=Choices(finish_reason='st...ider_specific_fields={}), input_type=Choices])
return self.pydantic_serializer.to_python(

Frostday · 2026-01-08T23:07:05Z

Thanks for raising the issue, James.

I've updated the requirements and README to install pdd separately for now.

Also, the issue was caused by a rare edge case where the LLM returned an empty rule. This has now been addressed by adding a test and regenerating. One additional point to note is that I’ve only been able to use this tool with Vertex models, as those are the only ones I currently have access to.

Noticed a potential issue: when I run pdd sync, it always extends the test cases first - even when the current tests are failing (maybe it should only extend if the current tests are passing?)

jamesdlevine · 2026-01-09T03:52:49Z

Installation fails on dependency versions - when pdd-cli is installed with pip. Pdd 0.0.106.

Try creating a clean environment from scratch, install pdd-cli with pip, then install the example according to the README instructions. Dependency installation (pip install -r ...) will fail on version issues. I hand edited requirements.text multiple times to loosen version restrictions, but there's a bit of a cascade of dependency issues I ran into.

Frostday · 2026-01-09T04:17:28Z

Did you try the alternate installation method?

Frostday · 2026-01-09T04:20:45Z

Cleaned up the requirements so that file should also work now.

jamesdlevine · 2026-01-09T05:21:02Z

Cleaned up the requirements so that file should also work now.

Did you test this fix in a clean environment?

Frostday · 2026-01-09T05:48:19Z

Cleaned up the requirements so that file should also work now.

Did you test this fix in a clean environment?

Yeah - Python 3.12

jamesdlevine · 2026-01-10T03:15:51Z

still seeing some conflicts (boldfaced)

[stuff removed]
...
Installing collected packages: watchdog, uvicorn, tornado, toml, pydantic-core, pyarrow, narwhals, cachetools, blinker, annotated-doc, starlette, rich, pydeck, pydantic, typer, fastapi, altair, streamlit, litellm
Attempting uninstall: pydantic-core
Found existing installation: pydantic_core 2.33.1
Uninstalling pydantic_core-2.33.1:
Successfully uninstalled pydantic_core-2.33.1
Attempting uninstall: rich
Found existing installation: rich 14.0.0
Uninstalling rich-14.0.0:
Successfully uninstalled rich-14.0.0
Attempting uninstall: pydantic
Found existing installation: pydantic 2.11.2
Uninstalling pydantic-2.11.2:
Successfully uninstalled pydantic-2.11.2
Attempting uninstall: litellm
Found existing installation: litellm 1.80.13
Uninstalling litellm-1.80.13:
Successfully uninstalled litellm-1.80.13
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
pdd-cli 0.0.107 requires pydantic==2.11.2, but you have pydantic 2.12.5 which is incompatible.
pdd-cli 0.0.107 requires rich==14.0.0, but you have rich 14.2.0 which is incompatible.
Successfully installed altair-6.0.0 annotated-doc-0.0.4 blinker-1.9.0 cachetools-6.2.4 fastapi-0.128.0 litellm-1.80.12 narwhals-2.15.0 pyarrow-22.0.0 pydantic-2.12.5 pydantic-core-2.41.5 pydeck-0.9.1 rich-14.2.0 starlette-0.50.0 streamlit-1.52.2 toml-0.10.2 tornado-6.5.4 typer-0.21.1 uvicorn-0.40.0 watchdog-6.0.0

jamesdlevine · 2026-01-10T03:46:19Z

Another thing the --fix option doesn't seem to do much. Other than that, I was able to test cli and web UIs (after working around the requiements.txt issue).

Frostday · 2026-01-10T04:03:29Z

still seeing some conflicts (boldfaced)

[stuff removed] ... Installing collected packages: watchdog, uvicorn, tornado, toml, pydantic-core, pyarrow, narwhals, cachetools, blinker, annotated-doc, starlette, rich, pydeck, pydantic, typer, fastapi, altair, streamlit, litellm Attempting uninstall: pydantic-core Found existing installation: pydantic_core 2.33.1 Uninstalling pydantic_core-2.33.1: Successfully uninstalled pydantic_core-2.33.1 Attempting uninstall: rich Found existing installation: rich 14.0.0 Uninstalling rich-14.0.0: Successfully uninstalled rich-14.0.0 Attempting uninstall: pydantic Found existing installation: pydantic 2.11.2 Uninstalling pydantic-2.11.2: Successfully uninstalled pydantic-2.11.2 Attempting uninstall: litellm Found existing installation: litellm 1.80.13 Uninstalling litellm-1.80.13: Successfully uninstalled litellm-1.80.13 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. pdd-cli 0.0.107 requires pydantic==2.11.2, but you have pydantic 2.12.5 which is incompatible. pdd-cli 0.0.107 requires rich==14.0.0, but you have rich 14.2.0 which is incompatible. Successfully installed altair-6.0.0 annotated-doc-0.0.4 blinker-1.9.0 cachetools-6.2.4 fastapi-0.128.0 litellm-1.80.12 narwhals-2.15.0 pyarrow-22.0.0 pydantic-2.12.5 pydantic-core-2.41.5 pydeck-0.9.1 rich-14.2.0 starlette-0.50.0 streamlit-1.52.2 toml-0.10.2 tornado-6.5.4 typer-0.21.1 uvicorn-0.40.0 watchdog-6.0.0

I built this tool using PDD v0.0.104 I think. I recommend using that version, as I don’t have control over dependency updates in future versions of the PDD package. It should work reliably with v0.0.104 or v0.0.100.

Also, the pydantic and rich packages should generally be compatible even if you’re using different versions. Could you share what changes you had to make to your environment to get the tool running?

Frostday · 2026-01-10T04:05:03Z

Another thing the --fix option doesn't seem to do much. Other than that, I was able to test cli and web UIs (after working around the requiements.txt issue).

Yes, I’m planning further model optimization and prompt refinements to improve the --fix functionality in v2. For now, the primary purpose of this example is to help with onboarding.

Frostday added 3 commits January 2, 2026 11:28

new example for onboarding

e7ac710

Merge branch 'main' of https://github.com/Frostday/pdd

e7372fe

Merge branch 'promptdriven:main' into main

5c00bd5

Frostday marked this pull request as draft January 2, 2026 19:36

Frostday changed the title ~~New example for onboarding people~~ New example for onboarding people + template for generating pddrc file Jan 3, 2026

added pddrc generation template

2e275fb

Frostday mentioned this pull request Jan 3, 2026

Automatic Generation of .pddrc file #244

Open

Frostday added 3 commits January 3, 2026 12:49

Merge branch 'promptdriven:main' into main

5fa71e7

Merge branch 'promptdriven:main' into main

205e9a2

updated example

f2298c9

Frostday marked this pull request as ready for review January 4, 2026 05:52

gltanaka requested a review from Copilot January 7, 2026 04:59

Copilot AI reviewed Jan 7, 2026

View reviewed changes

examples/prompts_linter/tests/test_llm.py Show resolved Hide resolved

examples/prompts_linter/tests/test_helpers.py Show resolved Hide resolved

examples/prompts_linter/src/cli/cli.py Show resolved Hide resolved

gltanaka reviewed Jan 7, 2026

View reviewed changes

Frostday added 4 commits January 7, 2026 10:36

Merge branch 'promptdriven:main' into main

e121eb6

pddrc generation improved

80cde9b

Merge branch 'main' of https://github.com/Frostday/pdd

8df53aa

improvements in the example - added makefile, requirements and bug fixes

47be243

gltanaka requested a review from Copilot January 8, 2026 02:04

Copilot AI reviewed Jan 8, 2026

View reviewed changes

bug fixed

5eaf372

requirements cleanup

986660d

		@@ -0,0 +1,108 @@
		<prompt>
		You are an expert Python developer architecting the `src/utils/fix.py` module for the PDD Prompt Linter. This module is the remediation engine responsible for transforming an original prompt text into a compliant version based on the analysis provided in a `Report` object. It operates in two modes: applying specific text replacements suggested by the LLM (patching) and enforcing structural integrity when critical PDD elements are missing (scaffolding).

New example for onboarding people + template for generating pddrc file #243

Are you sure you want to change the base?

New example for onboarding people + template for generating pddrc file #243

Uh oh!

Conversation

Frostday commented Jan 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Frostday commented Jan 3, 2026

Uh oh!

Frostday commented Jan 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

CLI:

Streamlit UI:

Uh oh!

jamesdlevine commented Jan 5, 2026

Uh oh!

Frostday commented Jan 5, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

gltanaka left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

gltanaka Jan 7, 2026

Choose a reason for hiding this comment

Uh oh!

Frostday Jan 8, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

gltanaka Jan 7, 2026

Choose a reason for hiding this comment

Uh oh!

Frostday Jan 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Frostday commented Jan 8, 2026

Uh oh!

gltanaka commented Jan 8, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Frostday commented Jan 8, 2026

Uh oh!

jamesdlevine commented Jan 8, 2026

Uh oh!

jamesdlevine commented Jan 8, 2026

pwd

pdd --version

cat /etc/issue

python -m src.cli.cli prompts/backend_api_python.prompt

Uh oh!

Frostday commented Jan 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jamesdlevine commented Jan 9, 2026

Uh oh!

Frostday commented Jan 9, 2026

Uh oh!

Frostday commented Jan 9, 2026

Uh oh!

jamesdlevine commented Jan 9, 2026

Uh oh!

Frostday commented Jan 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jamesdlevine commented Jan 10, 2026

still seeing some conflicts (boldfaced)

Uh oh!

Frostday commented Jan 2, 2026 •

edited

Loading

Frostday commented Jan 4, 2026 •

edited

Loading

Frostday Jan 8, 2026 •

edited

Loading

Frostday commented Jan 8, 2026 •

edited

Loading

Frostday commented Jan 9, 2026 •

edited

Loading

Frostday commented Jan 10, 2026 •

edited

Loading

Frostday commented Jan 10, 2026 •

edited

Loading