Simple MCP Server for TW - That is not simple anymore ;)

[pmario]

Hi folks,

I did just ask my "simple" MCP server this:

There is a WikiInformation tiddler with a button to create a detailed info. I want
you to try to get that info only using the MCP server.

• With the first run and zero knowledge of the real shadow tiddler name it failed.
  • Because the MCP has a strict rule always use: [!is[system]] ..
• It tried several variations but did not find it.
• It started to search for wiki_info which is a tool defined in the MCP server -> clever
• It found 2 doc tiddlers, which contain info about the mcp server itself.
  • no luck !is[system] blocked the info

I needed to interrupt it and let it search for shadows if it failed 2 or 3 times.

• Extended to rules and restart the server. -> Same question.
• [all[shadows]search:title[WikiInformation]] basically found it immediately
• get_tiddler - full text as .tid format reads the whole tiddler text
• It found out about the button display-wiki-info-modal
• render_tiddler renders it as text/plain-formatted -> no luck
• It found capture-wiki-info procedure
• It stopped by itself

It came back with some explanation, what it needs to get to that info. -> clever

• It wanted "full" execution rights :/ -> nope

I did add a render_text MCP tool that allows it render arbitrary text using the fake-dom and render it as HTML, text/plain-formatted or text/plain

• Same question: There is a WikiInformation tiddler with a button to create a detailed info. I want you to try to get that info only using the MCP server.
• It started with render_tiddler again -> no luck
• Read the startup info get_wiki_info which only contains some of that info but not everything
• It found the MCP tool render_text and built this code

● tiddlywiki - render_text (MCP)(text: "\\import [[$:/core/ui/ControlPanel/WikiInformation]]\n\n<$let
                               tempWikiInfo=\"$:/temp/wiki-info-mcp\" crlf={{{ [charcode[13],[10]] }}}>\n<$transclude
                               $variable=\"capture-wiki-info\" tempWikiInfo=<<tempWikiInfo>>/>\n<$transclude
                               $tiddler=<<tempWikiInfo>> $field=\"text\"/>\n</$let>")

• No luck
• It tried again with new text. Code below shortened

● tiddlywiki - render_text (MCP)(text: "TiddlyWiki Version: <<version>>\nCurrent palette: {{$:/>palette}}\nCurrent theme:
                               {{$:/theme}}\nCurrent layout: {{$:/layout}}\nDefault type for missing tiddlers:
                               {{$:/config/DefaultMissingType}}\nAuto save setting: {{$:/config/AutoSave}}\nCode
... snip ...
                               +[join[, ]] }}}")

• Lazy but almost there

---

Will need to teach it, how to use wikify and access to the widget-tree for internal variables.

[pmario]

I told it. There is something missing. It came up with the missing stuff.

I asked:

❯ Why did you not list the missing stuff from the beginnig?

● You're right — I had the full capture-wiki-info procedure source from earlier in the conversation. I should have
included all the fields it collects in my first render_text call instead of leaving some out. That was sloppy. I
missed:

• Browser language setting
• Tiddler opening from outside/inside story river
• Stylesheets

No good reason for it — I just didn't carefully replicate all the items from the procedure.

[pmario]

@Jermolene @linonetwo ... you may find this interesting

[pmario]

[pmario]

The links work \o/

[pmario]

[linonetwo]

Are you putting the title in the AST? I recently do that in the #9708 But my approach will only know it's from the title "Quick Start", We won't know the full transclusion stack.

[pmario]

In the parse-tree we already have the start / end postions of the source text. With a modified transclude-widget we also write this info to the widget-tree. When widgets are rendered, they write this info to the DOM into data- attributes.

There is a new plugin "sourcepos" (name will probably change), which contains some "debug" UI, that shows the complete call tree of a widget. The info can even go down to link text. The UI takes the info from data-source- attributes and reads the info from TW internal variables.

The same "inspect" code is available to the MCP server, which has a tool render_tiddler, that also contains this data-source info, which can then be used to inspect parse-tree and widget-tree variables. So the LLM will be able to inspect internal variables. ...

SOURCE TEXT                    PARSE TREE                     WIDGET TREE
─────────────                  ──────────                     ───────────
                               wikiparser.js                  widget.js
"!! Hello"                     ┌────────────────┐             ┌─────────────────────┐
 ^0    ^7                      │ type: "element"│             │ this.parseTreeNode  │──→ {start:0, end:7}
                               │ tag: "h2"      │             │ this.parentWidget   │
  parser.pos ──────────────→   │ start: 0       │─────────→   │ this.variables      │
  tracks char offsets          │ end: 7         │             │ this.sourceContext  │
                               │ children: []   │             │   (set by monkey-   │
  Rules set start/end:         └────────────────┘             │    patched          │
  - wikilink.js                                               │    transclude.js)   │
  - heading.js                 macrodef.js/fnprocdef.js       └────────┬────────────┘
  - image.js                   also store:                             │
  - codeblock.js               - sourceTitle                           │
  - etc.                       - isMacroDefinition                     │
                               - isProcedureDefinition                 │
                               - params                                │
                                                                       │
                                                                       ▼
                                                              ┌───────────────────┐
                                                              │ HOOKS fire during │
                                                              │ widget.render()   │
                                                              ├───────────────────┤
                                                              │ th-dom-rendering- │
                                                              │   element         │
                                                              │   link            │
                                                              │   codeblock       │
                                                              └────────┬──────────┘
                                                                       │
                                          startup.js:addSourcePos()    │
                                          ┌────────────────────────────┘
                                          │
                                          ▼
                              ┌─────────────────────────────────────┐
                              │         TRANSFORM PIPELINE          │
                              │                                     │
                              │  getSourceInfo(widget)              │
                              │    └→ walk parentWidget chain       │
                              │       find sourceContext + offset   │
                              │                                     │
                              │  absStart = ptn.start + offset      │
                              │  absEnd   = ptn.end   + offset      │
                              │                                     │
                              │  getLineOffsets(title)              │
                              │    └→ cached array of line starts   │
                              │                                     │
                              │  charToLine(offsets, absStart)      │
                              │    └→ binary search → line number   │
                              │                                     │
                              │  getTidHeaderLines(title)           │
                              │    └→ count fields + 1 blank line   │
                              │                                     │
                              │  startLine + headerOffset           │
                              │  endLine   + headerOffset           │
                              │                                     │
                              │  buildCallerChain(widget)           │
                              │    └→ walk parents for transclusion │
                              │       context chain                 │
                              └────────────────┬────────────────────┘
                                               │
                                               ▼
DOM ELEMENT                                                    
───────────                                                    
┌─────────────────────────────────────────────────────────┐    
│  <h2                                                    │    
│    data-source-pos    = "L12-L12 @ MyTiddler"           │    
│    data-source-start  = "0"                             │    
│    data-source-end    = "7"                             │    
│    data-source-context= "Welcome"        (if differs)   │    
│    data-source-caller = "← TOC ← tabs ← SideBar ←..."   │    
│    ._twWidget         = widget ref                      │    
│  >                                                      │    
│    Hello                                                │    
│  </h2>                                                  │    
└────────────────────────┬────────────────────────────────┘    
                         │                                     
          ┌──────────────┼──────────────────┐                  
          ▼              ▼                  ▼                  
   ┌─────────────┐ ┌──────────┐  ┌───────────────────┐        
   │   HOVER     │ │  CTRL+   │  │   RIGHT-CLICK     │        
   │  mouseover  │ │  CLICK   │  │   contextmenu     │        
   │  (400ms)    │ │          │  │                   │        
   └──────┬──────┘ └────┬─────┘  └────────┬──────────┘        
          │             │                 │                    
          ▼             ▼                 ▼                    
   ┌─────────────┐ ┌──────────┐  ┌───────────────────┐        
   │  TOOLTIP    │ │ NAVIGATE │  │   CONTEXT MENU    │        
   │             │ │ to source│  │                   │        
   │ "L12 @ My"  │ │ tiddler  │  │ ┌───────────────┐ │        
   │ "» Welcome" │ │          │  │ │Copy title     │ │        
   │ "← TOC..."  │ │          │  │ │Copy position  │ │        
   └─────────────┘ └──────────┘  │ │Edit at pos  ──┼─┼──→ EDITOR        
                                 │ │Show source  ──┼─┼──→ SOURCE VIEWER  
                                 │ │Inspect vars  ─┼─┼──→ VAR INSPECTOR  
                                 │ └───────────────┘ │        
                                 └───────────────────┘        
                                                              
          ┌──────────────────────────────────────┐             
          │         SOURCE VIEWER                │             
          │  source-viewer.js                    │             
          │                                      │             
          │  charStart/charEnd → extract snippet │             
          │  from tiddler text                   │             
          │                                      │             
          │  ┌────────────────────────────────┐  │             
          │  │ \procedure toc-tab-content()   │  │             
          │  │   <$list filter=...>           │  │             
          │  │     <<toc-linked-expandable>>  │  │             
          │  │   </$list>                     │  │             
          │  └────────────────────────────────┘  │             
          │                                      │             
          │  hover entry → highlight DOM element │             
          └──────────────────────────────────────┘             
                                                              
          ┌──────────────────────────────────────┐             
          │       VARIABLE INSPECTOR             │             
          │  click-handler.js                    │             
          │                                      │             
          │  ._twWidget → findWidget(target)     │             
          │       │                              │             
          │       ▼                              │             
          │  collectVariables(widget)            │             
          │    └→ walk parentWidget chain        │             
          │       collect all var/macro/proc/def │             
          │                                      │             
          │  ┌────────────────────────────────┐  │             
          │  │ var toc-state = $:/state/...   │  │             
          │  │ mac currentTiddler = Welcome   │  │             
          │  │ proc toc-linked = ...          │  │             
          │  └────────────────────────────────┘  │             
          │                                      │             
          │  live update via th-page-refreshed   │             
          │  relocate via isWidgetAlive()        │             
          └──────────────────────────────────────┘             
                                                              
CONFIG                                                        
──────                                                        
$:/config/SourcePositionTracking = "yes"                      
    │                                                         
    └→ startup.js:updateTracking()                            
         └→ $tw.wiki.trackSourcePositions = true/false        
              └→ controls whether addSourcePos() runs         
                 and clears all caches on toggle              

So it's possible to access every element from the widget tree. The debug UI is able select macro code, that generated the HTML element with a button click. -- That's really cool.

Here's the branch you can play with: https://github.com/pmario/TiddlyWiki5/tree/simple-tw-mcp-server
There are some documentation tiddlers prefixed MCP ...
Have fun!