Transformers
Sequence models that replace recurrence with attention.
Built on . Introduced in [@vaswani2017].
Self-attention
Every token attends to every other token in one step:
Attention(Q,K,V) = softmax(QK⊤ / √dk) V
See the paper, page 3:
Open source · Local-first · Markdown
Your notes should outlive the app.
Neoma is an open-source, local-first research journal built on plain Markdown. Work offline, link ideas, search everything and keep your files yours.
- No account
- No cloud required
- Works offline
- AGPL-3.0
Try Neoma
Transformers
LocalOffline readyMarkdown
60 words · saved
A real vault, in miniature. Click a link, press ⌘ K, or open the graph.
Your files are the product
Plain Markdown.Nothing proprietary.
A Neoma vault is a folder of .md files. Links, tags, properties and citations
are ordinary Markdown that any editor can read. Close Neoma, open the folder, and everything
is still there.
-
Readable anywhere. VS Code, Obsidian, GitHub,
cat. - Frontmatter kept verbatim. Fields Neoma does not know are never deleted.
- Leave whenever you like. There is nothing to export from. It is already files.
$ tree . ├── Home.md ├── Sources.md ├── Transformers.md ├── Neural Networks.md └── Attachments/ └── attention.pdf $ cat Transformers.md --- tags: [ml, architecture] status: reading --- # Transformers Sequence models that replace recurrence with attention. Built on [[Neural Networks]]. Introduced in [@vaswani2017].
Linked knowledge
Link everything.
Type [[ and pick a note. Every link becomes a backlink on the other side, and
the graph shows how the pieces connect. Rename a note and the links to it are rewritten.
Built on [[Neu
#heading targets.
Backlinks 3
HomeStart here. Transformers, Neural…
SourcesNotes on these live in Transformers…
Unlinked mention…like transformers, these models…
Research workflow
From the paper to what you understand.
Neoma is built for reading and thinking, not just writing. Each step is ordinary Markdown, so the work stays portable the whole way through.
-
01
Read
An offline PDF viewer with selectable text, search and thumbnails. Split view puts your note beside the page.
[[paper.pdf#page=12]] -
02
Annotate
Highlights, callouts, maths with KaTeX, theorem and proof blocks, Pandoc citation keys.
[@vaswani2017] -
03
Link
Wiki links, embeds, tags and properties. Daily notes keep a dated trail of your thinking.
![[Sources#2017]] -
04
Find
Full-text search on your device, with tag, path, type and date filters. The graph for the bigger picture.
tag:ml attention -
05
Review
Questions in your notes become flashcards. Study mode and an exam dashboard, all offline.
Question:: … -
06
Publish
Turn selected notes into a static website, built on your device.
_site/index.html
Offline and private
Local means local.
Your vault stays on your device. Neoma opens it, indexes it and renders it right there, with no server in between.
- No account. There is nothing to sign in to.
- No telemetry. No analytics, crash reporting or usage data.
- No remote AI. Your notes are never sent to a model.
- No background uploads. Remote images are blocked until you allow them.
- No proprietary database. The files are the source of truth.
- Your files~/Research/*.md
- Neomaon this device
- Search · Graph · Publishlocal index
No cloud in the middle.
Publish
Turn a vault into a website.
Pick the notes, pick a theme, and Neoma writes a static site to a folder. Links, maths, callouts and search come with it. Host the folder anywhere that serves files.
- Static output. HTML and CSS, with a tiny script for search.
- Built locally. The same renderer as the editor.
- Nothing is uploaded by Neoma. You choose where it goes.
- vault/Markdown
- Publishon your device
- index.htmlany static host
Open source
Read it.Fork it. Change it.
The web edition of Neoma is free software under the AGPL. Every line that touches your notes is public, and you can run your own copy.
- Licence
- AGPL-3.0-or-later
- Repository
- infinitumio/neoma
- Stars
- 6
- Forks
- 2
- Latest release
- v0.3.0
- Last commit
- 7 Oct 2026
Download
Wherever you work.
The web app needs no install and works offline after the first visit. Desktop apps for macOS, Windows and Linux; iPhone and iPad in beta.
Community
Built in the open.
Neoma is small, independent and on GitHub. Every contribution, from a typo fix to a bug report, makes it better.
Contribute
Set up in three commands. Good first issues are labelled.
Report a bug
Steps to reproduce, and what you expected.
Request a feature
Describe the problem first. The roadmap is public.
Extend Neoma
Commands, panels and Markdown extensions register through public registries.
Improve the docs
The docs are a Neoma vault in the repository.
Sponsor
Keep an independent tool independent.