Skip to content

TelegramMessenger/libprisma

Repository files navigation

This is a C++ porting of prism.js library. The code depends on Boost.Regex, as it's a faster and more comprehensive than STD's.

Grammars file is generated from prism.js source code itself, instructions later in the file.

Key concepts:

string text = ReadFile("grammars.dat");
m_highlighter = std::make_shared<SyntaxHighlighter>(text);
TokenList tokens = m_highlighter->tokenize(code, language);

for (auto it = tokens.begin(); it != tokens.end(); ++it)
{
    auto& node = *it;
    if (node.isSyntax())
    {
        const auto& child = dynamic_cast<const Syntax&>(node);
        // child.type() <- main token type (eg "include")
        // child.alias() <- "base" token type (eg "keyword")
        // child.begin() + node.end() <- list of tokens
    }
    else
    {
        const auto& child = dynamic_cast<const Text&>(node);
        // child.value() <- the actual text to highlight
    }
}

How to update

Run

npm install
npm start

The new version of grammars.dat will appear in the libprisma/grammars.dat.

Supported languages

Language Aliases
Markup markup,markup,html,xml,svg,mathml,ssml,atom,rss
CSS css
C-like clike
Regex regex
JavaScript javascript,js
ABAP abap
ABNF abnf
ActionScript actionscript
Ada ada
Agda agda
AL al
ANTLR4 antlr4,g4
Apache Configuration apacheconf
SQL sql
Apex apex
APL apl
AppleScript applescript
AQL aql
C c
C++ cpp
Arduino arduino,ino
ARFF arff
ARM Assembly armasm,arm-asm
Bash bash,bash,sh,shell
YAML yaml,yml
Markdown markdown,md
Arturo arturo,art
AsciiDoc asciidoc,adoc
C# csharp,csharp,cs,dotnet
ASP.NET (C#) aspnet
6502 Assembly asm6502
Atmel AVR Assembly asmatmel
AutoHotkey autohotkey
AutoIt autoit
AviSynth avisynth,avs
Avro IDL avro-idl,avdl
AWK awk,gawk
BASIC basic
Batch batch
BBcode bbcode,shortcode
BBj bbj
Bicep bicep
Birb birb
Bison bison
BNF bnf,rbnf
BQN bqn
Brainfuck brainfuck
BrightScript brightscript
Bro bro
CFScript cfscript,cfc
ChaiScript chaiscript
CIL cil
Cilk/C cilkc,cilk-c
Cilk/C++ cilkcpp,cilkcpp,cilk-cpp,cilk
Clojure clojure
CMake cmake
COBOL cobol
CoffeeScript coffeescript,coffee
Concurnas concurnas,conc
Content-Security-Policy csp
Cooklang cooklang
Ruby ruby,rb
Crystal crystal
CSV csv
CUE cue
Cypher cypher
D d
Dart dart
DataWeave dataweave
DAX dax
Dhall dhall
Diff diff
Markup templating markup-templating
Django/Jinja2 django,jinja2
DNS zone file dns-zone-file,dns-zone
Docker docker,dockerfile
DOT (Graphviz) dot,gv
EBNF ebnf
EditorConfig editorconfig
Eiffel eiffel
EJS ejs,eta
Elixir elixir
Elm elm
Lua lua
Embedded Lua templating etlua
ERB erb
Erlang erlang
Excel Formula excel-formula,excel-formula,xlsx,xls
F# fsharp
Factor factor
False false
Fift fift
Firestore security rules firestore-security-rules
Flow flow
Fortran fortran
FreeMarker Template Language ftl
FunC func
GameMaker Language gml,gamemakerlanguage
GAP (CAS) gap
G-code gcode
GDScript gdscript
GEDCOM gedcom
gettext gettext,po
Git git
GLSL glsl
GN gn,gni
GNU Linker Script linker-script,ld
Go go
Go module go-module,go-mod
Gradle gradle
GraphQL graphql
Groovy groovy
Less less
Sass (SCSS) scss
Textile textile
Haml haml
Handlebars handlebars,handlebars,hbs,mustache
Haskell haskell,hs
Haxe haxe
HCL hcl
HLSL hlsl
Hoon hoon
HTTP Public-Key-Pins hpkp
HTTP Strict-Transport-Security hsts
JSON json,webmanifest
URI uri,url
HTTP http
IchigoJam ichigojam
Icon icon
ICU Message Format icu-message-format
Idris idris,idr
.ignore ignore,ignore,gitignore,hgignore,npmignore
Inform 7 inform7
Ini ini
Io io
J j
Java java
Scala scala
PHP php
JavaDoc-like javadoclike
JavaDoc javadoc
Java stack trace javastacktrace
Jolie jolie
JQ jq
TypeScript typescript,ts
JSDoc jsdoc
N4JS n4js,n4jsd
JSON5 json5
JSONP jsonp
JS stack trace jsstacktrace
Julia julia
Keepalived Configure keepalived
Keyman keyman
Kotlin kotlin,kotlin,kt,kts
Kusto kusto
LaTeX latex,latex,tex,context
Latte latte
Scheme scheme
LilyPond lilypond,ly
Liquid liquid
Lisp lisp,lisp,emacs,elisp,emacs-lisp
LiveScript livescript
LLVM IR llvm
Log file log
LOLCODE lolcode
Magma (CAS) magma
Makefile makefile
Mata mata
MATLAB matlab
MAXScript maxscript
MEL mel
Mermaid mermaid
METAFONT metafont
Mizar mizar
MongoDB mongodb
Monkey monkey
MoonScript moonscript,moon
N1QL n1ql
Nand To Tetris HDL nand2tetris-hdl
Naninovel Script naniscript,nani
NASM nasm
NEON neon
Nevod nevod
nginx nginx
Nim nim
Nix nix
NSIS nsis
Objective-C objectivec,objc
OCaml ocaml
Odin odin
OpenCL opencl
OpenQasm openqasm,qasm
Oz oz
PARI/GP parigp
Parser parser
Pascal pascal,objectpascal
Pascaligo pascaligo
PATROL Scripting Language psl
PC-Axis pcaxis,px
PeopleCode peoplecode,pcode
Perl perl
PHPDoc phpdoc
PlantUML plant-uml,plantuml
PL/SQL plsql
PowerQuery powerquery,powerquery,pq,mscript
PowerShell powershell
Processing processing
Prolog prolog
PromQL promql
.properties properties
Protocol Buffers protobuf
Stylus stylus
Twig twig
Pug pug
Puppet puppet
PureBasic purebasic,pbfasm
Python python,py
Q# qsharp,qs
Q (kdb+ database) q
QML qml
Qore qore
R r
Racket racket,rkt
Razor C# cshtml,razor
React JSX jsx
React TSX tsx
Reason reason
Rego rego
Ren'py renpy,rpy
ReScript rescript,res
reST (reStructuredText) rest
Rip rip
Roboconf roboconf
Robot Framework robotframework,robot
Rust rust
SAS sas
Sass (Sass) sass
Shell session shell-session,shell-session,sh-session,shellsession
Smali smali
Smalltalk smalltalk
Smarty smarty
SML sml,smlnj
Solidity (Ethereum) solidity,sol
Solution file solution-file,sln
Soy (Closure Template) soy
Splunk SPL splunk-spl
SQF: Status Quo Function (Arma 3) sqf
Squirrel squirrel
Stan stan
Stata Ado stata
Structured Text (IEC 61131-3) iecst
SuperCollider supercollider,sclang
Swift swift
Systemd configuration file systemd
Tact tact
T4 templating t4-templating
T4 Text Templates (C#) t4-cs,t4
VB.Net vbnet
T4 Text Templates (VB) t4-vb
TAP tap
Tcl tcl
Template Toolkit 2 tt2
TOML toml
Tremor tremor,tremor,trickle,troy
Type Language tl
Type Language - Binary tlb
TypoScript typoscript,tsconfig
UnrealScript unrealscript,unrealscript,uscript,uc
UO Razor Script uorazor
V v
Vala vala
Velocity velocity
Verilog verilog
VHDL vhdl
vim vim
Visual Basic visual-basic,visual-basic,vb,vba
WarpScript warpscript
WebAssembly wasm
Web IDL web-idl,webidl
WGSL wgsl
Wiki markup wiki
Wolfram language wolfram,wolfram,mathematica,nb,wl
Wren wren
Xeora xeora,xeoracube
Xojo (REALbasic) xojo
XQuery xquery
YANG yang
Zig zig