Skip to content

Commit 3591633

Browse files
committed
AI split out, renderStatiPages works when Live
1 parent 22a0623 commit 3591633

File tree

164 files changed

+11460
-1408
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

164 files changed

+11460
-1408
lines changed

ai-metadata-spec.html

Lines changed: 71 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,11 +6,11 @@
66
<meta name="description" content="Specification for custom metadata fields used by ProcStack to aid AI and LLM systems in data discovery.">
77
</head>
88
<body>
9-
<h1>ProcStack's AI Metadata Specification v0.1</h1>
10-
<h4> Updated : June 17th 2025</h4>
9+
<h1>ProcStack's AI Metadata Specification v0.2</h1>
10+
<h4> Updated : August 1st 2025</h4>
1111

1212
<p>This document defines custom metadata and link conventions used across the ProcStack project pages to expose structured data to bots, crawlers, and language models.</p>
13-
<p>This document is a work in progress, structure for json's to be added shortly.</p>
13+
<p>This specification includes JSON schema definitions and comprehensive discovery methods for AI systems.</p>
1414

1515
<h2>Meta Tags</h2>
1616
<ul>
@@ -24,8 +24,51 @@ <h2>Link Tags</h2>
2424
<ul>
2525
<li><code>&lt;link rel="alternate" type="application/json" ...&gt;</code> - JSON representation of the full site or specific page.</li>
2626
<li><code>&lt;link rel="data-manifest" ...&gt;</code> - Points to the master structured content manifest (site-wide JSON).</li>
27+
<li><code>&lt;link rel="ai-meta-spec" ...&gt;</code> - Points to this specification document for reference.</li>
2728
</ul>
2829

30+
<h2>Discovery Files</h2>
31+
<ul>
32+
<li><strong>data-manifest.json</strong> - Master manifest with all available data sources, schemas, and metadata</li>
33+
<li><strong>llms.txt</strong> - LLM-friendly text summary following community standards</li>
34+
<li><strong>sitemap.xml</strong> - Standard sitemap with lastmod dates for change detection</li>
35+
<li><strong>robots.txt</strong> - Includes AI-specific directives and manifest references</li>
36+
</ul>
37+
38+
<h2>JSON Data Schema</h2>
39+
<h3>Individual Page Data (e.g., /bots/PageName.htm.json)</h3>
40+
<pre>
41+
{
42+
"title": "string",
43+
"description": "string",
44+
"lastModified": "YYYY-MM-DD",
45+
"media": [
46+
{
47+
"type": "video|image",
48+
"src": "relative/path/to/media",
49+
"alt": "alt text",
50+
"caption": "media description"
51+
}
52+
]
53+
}
54+
</pre>
55+
56+
<h3>Site Content Manifest (/bots/siteContent.json)</h3>
57+
<pre>
58+
{
59+
"[pageKey]": {
60+
"jsonURL": "absolute URL to page JSON",
61+
"lastModified": "YYYY-MM-DD",
62+
"title": "page title",
63+
"description": "page description",
64+
"media": [...],
65+
"content": "full HTML content",
66+
"pageURL": "absolute page URL",
67+
"relativeURL": "relative page path"
68+
}
69+
}
70+
</pre>
71+
2972
<h2>Use Cases</h2>
3073
<ul>
3174
<li>Allow AI crawlers to skip parsing raw HTML and use the structured JSON directly</li>
@@ -59,6 +102,31 @@ <h2>Example 3 - API End-Point</h2>
59102
&lt;meta name="ai:content-api" content="https://procstack.github.io/bots/"&gt;
60103
</pre>
61104

105+
<h2>Example 4 - Enhanced robots.txt</h2>
106+
<pre>
107+
User-agent: *
108+
Allow: /
109+
110+
# AI/LLM specific directives
111+
User-agent: GPTBot
112+
Allow: /
113+
User-agent: ChatGPT-User
114+
Allow: /
115+
116+
# Data endpoints
117+
AI-Data-Manifest: https://procstack.github.io/data-manifest.json
118+
AI-Content-API: https://procstack.github.io/bots/
119+
</pre>
120+
121+
<h2>Discovery Workflow for AI Systems</h2>
122+
<ol>
123+
<li>Check robots.txt for AI-Data-Manifest directive</li>
124+
<li>Fetch data-manifest.json for complete data source overview</li>
125+
<li>Use siteContent.json for bulk content or individual page JSON for specific content</li>
126+
<li>Parse llms.txt for human-readable content summary</li>
127+
<li>Respect lastModified dates to avoid unnecessary re-crawling</li>
128+
</ol>
129+
62130
<footer>
63131
<p>Created by Kevin Edzenga - <a href="https://procstack.github.io/">https://procstack.github.io/</a></p>
64132
</footer>

bots/AIDev_aiIntro.htm.json

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
{
2+
"title": "My Introduction",
3+
"description": "I started my dive into AI in 2008 writing a Boid / Crowd system for my thesis while in art college, School of Visual Arts.",
4+
"lastModified": "2025-08-01",
5+
"media": [
6+
{
7+
"type": "youtube",
8+
"src": "XJu-UJrI6yk",
9+
"alt": "Useful AI for Visual Graphics",
10+
"caption": ""
11+
}
12+
]
13+
}

bots/AIDev_aiNotes.htm.json

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
{
2+
"title": "Notes & Research",
3+
"description": "If you couldn't tell, I'm training my AIs on my own works.",
4+
"lastModified": "2025-07-31",
5+
"media": []
6+
}
Lines changed: 9 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,35 +1,29 @@
11
{
2-
"title": "AI Dev",
3-
"description": "I started my dive into AI in 2008 writing a Boid / Crowd system for my thesis while in art college, School of Visual Arts.",
4-
"lastModified": "2025-05-07",
2+
"title": "ESN & Motion Prediction",
3+
"description": "How about an Echo State Network (ESN) AI I wrote in the spring-summer of 2024?\n \n An ESN is a type of 'reservoir' network,\n Which considers time in its prediction.",
4+
"lastModified": "2025-07-31",
55
"media": [
66
{
77
"type": "video",
8-
"src": "../pages/aboutMe/images/dgat_generativeStrings_15.webm",
9-
"alt": "Dynamic Graph Attention Network",
10-
"caption": "Generative connections in a dynamic Graph Attention Network (GAT); Finding connections between a block of text I wrote up. The network is creating connections between 'usage rules' of different words."
11-
},
12-
{
13-
"type": "video",
14-
"src": "../pages/aboutMe/images/learningGradients_dev02_18_loop.webm",
8+
"src": "../pages/aiDev/images/learningGradients_dev02_18_loop.webm",
159
"alt": "ESN Horizontal-Vertical Slice",
1610
"caption": "A vertical slice of horizontal movement in my Echo State Network (ESN) brain. I'm showing a 2D slice of a side-to-side movement. The repeating gray tones are patterns of 'relative' movement, Like a 'motion offset' found in similar prior frames."
1711
},
1812
{
1913
"type": "video",
20-
"src": "../pages/aboutMe/images/esnLearning.webm",
21-
"alt": "ESN Horizontal-Vertical Slice",
14+
"src": "../pages/aiDev/images/esnLearning.webm",
15+
"alt": "ESN Learning Process",
2216
"caption": "ESN test run; Upper Left are videos I made, Upper Right are learning rates in RGB, Red shows 'known' patterns, Green are pattern edges, & Blue 'might be' patterns. The Bottom is what the brain thinks its seeing & then predicting."
2317
},
2418
{
2519
"type": "video",
26-
"src": "../pages/aboutMe/images/learningGradients_84.webm",
27-
"alt": "ESN Horizontal-Vertical Slice",
20+
"src": "../pages/aiDev/images/learningGradients_84.webm",
21+
"alt": "ESN Different Slices",
2822
"caption": "Different slices from the same ESN, with different input video. Upper left is a video I made the AI's watching, upper right is detecting movement; Lower left is the brain's wrinkles, lower right is predicted movement."
2923
},
3024
{
3125
"type": "image",
32-
"src": "../pages/aboutMe/images/learningGradients_84_brainSlice.png",
26+
"src": "../pages/aiDev/images/learningGradients_84_brainSlice.png",
3327
"alt": "Custom ESN Learning Gradients",
3428
"caption": "A slice of the ESN's brain by frame 101 of watching the X pattern video."
3529
}
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
{
2+
"title": "GAT & Language",
3+
"description": "For my 2026 goal, I've been exploring Graph Attention Network (GAT) artificial intelligence.",
4+
"lastModified": "2025-07-31",
5+
"media": [
6+
{
7+
"type": "video",
8+
"src": "../pages/aiDev/images/dgat_generativeStrings_15.webm",
9+
"alt": "Dynamic Graph Attention Network",
10+
"caption": "Generative connections in a dynamic Graph Attention Network (GAT); Finding connections between a block of text I wrote up. The network is creating connections between 'usage rules' of different words."
11+
}
12+
]
13+
}

0 commit comments

Comments
 (0)