pandoc 3.9.0.2

I'm pleased to announce the release of pandoc 3.9.0.2,
available in the usual places:

Binary packages & changelog:
https://github.com/jgm/pandoc/releases/tag/3.9.0.2

Source & API documentation:
http://hackage.haskell.org/package/pandoc-3.9.0.2

This release just fixes a bad regression in the typst template.

Click to expand changelog

• Typst template: fix regression introduced in 3.9.0.1 (#11538).

pandoc 3.9.0.1

I'm pleased to announce the release of pandoc 3.9.0.1,
available in the usual places:

Binary packages & changelog:
https://github.com/jgm/pandoc/releases/tag/3.9.0.1

Source & API documentation:
http://hackage.haskell.org/package/pandoc-3.9.0.1

This is a bug-fix release, with no major new features or
API changes, but lots of small improvements. See the
changelog for details.

Thanks to all who contributed, especially new contributors
Agriya Khetarpal, Peter Briggs, Sidney Mau, and λx.x.

Click to expand changelog

• WASM GUI:

  • Don’t block everything while pandoc.wasm loads.
  • Fix bug with Unicode filenames (#11447).
  • Catch errors loading pandoc.

• Docx reader:

  • Recognize media inside textboxes (#11053, Raymond Berger).
  • Properly handle media stored with packaged-rooted paths such as /media (#11518). This can be produced by the online version of Word. With this change, media stored at an absolute path will be stored with its original name and not given a SHA1-based name.
  • Preserve non-textbox content when unwrapping textboxes (#11510, #6893, #11412, #5394, #9633). Treat text inside a textbox containing an image as a figure caption.

• Typst reader:

  • Handle bibliography command (#11460). If this is present, a bibliography section is added to the document and the bibliography paths are added to bibliography in the metadata. This sets things up for using --citeproc.

• Textile reader:

  • Handle block content in cells (#11455).

• Docx reader:

  • Support w:gridBefore table row property (#11464, Jan Tojnar).

• LaTeX reader:

  • Support \footnotemark and \footnotetext (#11450). These commands allow separating the footnote mark from its content, useful in tables, minipages, and other contexts where \footnote cannot be used directly.
  • Support supertabular environment (#11523, bodigrim).

• ODT Reader:

  • Fix relative linked images (#11369, Tuong Nguyen Manh).
  • Recognize Preformatted_20_Text style Jan Tojnar This is used by LibreOffice, and we will switch to that as well.
  • Add block smushing logic (Jan Tojnar).
  • Support Preformatted Text style (#4841, Jan Tojnar).

• Markdown reader:

  • Fix bug with lists_without_preceding_blankline (#11534).

• Typst writer:

  • Don’t add a carriage return after \ for hard break (#11446). They are not necessary. Note that they can still be included if you use --wrap=preserve and add a newline in your source document.
  • Improve handling of data: URIs in images. Instead of using an SVG with a link containing the data URI (the solution of #10460), we can now simply produce a bytes object with the requisite bytes. Typst figures out the format automatically.
  • Fix escaping of quotes (#11463).
  • Include alt attributes on images (mcanouil).
  • Properly escape . after bracketed argument (#11511).

• Docx writer:

  • Don’t depend on extractTarget from Docx reader.
  • Fix section breaks with --top-level-division (#11482, #10578).

• EPUB writer:

  • Add cover metadata for EPUB3 (#11479). This allows file managers to show cover thumbnails for EPUB3 files as well.
  • Update allowed values for EPUB3 metadata identifier.scheme (#11481, Pascal Wagler).

• ODT writer:

  • Rename inline source class to match LibreOffice (#3390, Jan Tojnar). Rename the text style we use to represent Code inlines from Source_20_Text to Source_Text. This is the same name LibreOffice Writer uses so it will be recognized by the Character Styles section of the Styles menu.
  • Remove font size from inline source class (Jan Tojnar). This matches what LibreOffice Writer is doing. Also fixes literals inside headings being too small.
  • Modernize Preformatted Text & Source Text styles (Jan Tojnar). Presumably, font-family-generic and font-pitch will allow to find a replacement on systems that do not have Courier New.

• Markdown writer:

  • Fix rendering of alerts (#11479). We only properly handled the case where the alert started with a paragraph, but it can start with a list or other block type.
  • Escape literal & that would trigger entity (#11490).

• HTML writer:

  • For revealjs, default scrollProgress to auto (Christophe Dervieux).

• PPTX writer:

  • Register content type for embedded fonts (#11492).

• MediaWiki writer:

  • Use appropriate syntax for external images (#11494). Note that they will only be rendered as images if an option $wgAllowExternalImages is enabled in the MediaWiki instance.

• ICML writer:

  • Support for image object styles (#11498, massifrg). This change allows users to style images in InDesign bysetting the object-style attribute in a pandoc Image, which is mapped to the AppliedObjectStyle attribute in the Rectangle element around an Image element in the resulting ICML.

• JATS writer:

  • Improve representation of Divs (Albert Krewinkel). The writer now checks if the element used to represent (non-special) Divs has any <boxed-text> specific attributes. If it does, the writer keeps wrapping the Div contents in a <boxed-text>, as it did before. Otherwise, the writer falls back to the more appropriate <p> element or simply unwraps the Div if the wrapping element wouldn’t have any attributes. The new behavior gives better semantic results in most cases, as <boxed-text> should be used for text that “is outside the flow of the narrative text”, which doesn’t apply to most divs. “Special” divs, like those used to mark sections, are not affected by this change.

• Text.Pandoc.Writers.GridTable:

  • Normalize tables (#8102). Previously, if an invalid table was passed to toTable, an array index error could be raised. Normalizing the table forces it into a shape that won’t allow this error.

• Lua subsystem (Albert Krewinkel):

  • Add new function pandoc.types.Sources (#11441).

• LaTeX template: properly handle keywords with commas. These need to be put in an \xmpquote{..} command. Closes #11528.

• HTML styles template: avoid duplicate code selector. Consolidate two clauses. Closes #11484.

• Revealjs template: fix type rendering of scroll-view options (Christophe Dervieux, #11486).

• Typst template:

  • Use both place and block for title (Gordon Woodhull). Otherwise the title will be confined to the left column
  • Put title block in a conditional (#11529). This avoids an empty block for documents that lack metadata information. The empty block causes problems if #set page is used, as it will cause a page break.

• Beamer template: add logooption variable (#11452, Sidney Mau).

• Text.Pandoc.ImageSize:

  • Correctly handle percentage width, height on SVG (#11530). Previously we were getting image size of 0 when a percentage was specified for width or height on SVG. With this change, we simply ignore these percentages (becaues ImageSize doesn’t know the size of the containing element).

• Re-add -threaded to compile options in pandoc-cli.

• Use released djot, asciidoc, texmath, typst.

• Allow crypton 1.1, tls 2.2, http-client-tls 0.4.

• Require auto-update >= 0.2.6 to fix server on macOS (#11488).

• pandoc-cli.cabal: bump base min bound to 4.18 (same as pandoc).

• MANUAL.txt:

  • Note that JSON may be used in YAML metadata blocks (#11525).
  • Update link for ICML in manual.
  • Fix outdated OPML spec URL in MANUAL.txt (#11504, Peter Briggs).

pandoc 3.9

I'm pleased to announce the release of pandoc 3.9,
available in the usual places:

Binary packages & changelog:
https://github.com/jgm/pandoc/releases/tag/3.9

Source & API documentation:
http://hackage.haskell.org/package/pandoc-3.9

Starting with this release, pandoc can be compiled to WASM, making it
possible to use pandoc in the browser.  A full-featured GUI interface
is provided at https://pandoc.org/app.

Defaults files may now be in either JSON or YAML, and variable
interpolation works now for the `defaults` field of a defaults file,
making it easier for defaults files to extend others.

--extract-media will now create a zip archive containing the media
(instead of a directory) if the specified path has a .zip extension.

A special class on headings can now be used to reset 'subsequent'
status for citations processed using --citeproc. This can be important
for some styles, which require that full citation information be given
for the first citation to a work in any given chapter.

The 'alerts' extension can now be used with pandoc's Markdown.

Support has been added for PDF standards and tagging via lualatex.

API changes:

- Text.Pandoc.Shared exports hasLineBreaks.
- The PandocHttpError constructor for PandocError now takes
  a Text as argument instead of HttpException.

Thanks to all who contributed, especially new contributors Albert
Lei, Anton Melnikov, Chris Callison-Burch, Jacob Larkin, Yann
Trividic, You Jiangbin, benniekiss, and har7an.

Click to expand changelog

• Add support for compiling pandoc to WASM. (To build, make pandoc.wasm.) A stanza in cabal.project contains the necessary build modifications. We owe this almost entirely to TerrorJack, who created the original proof of context and came up with the necessary build flags and patches to some dependencies.

  pandoc.wasm has almost all the power of regular pandoc. The main limitations is that it operates in a WASM sandbox and thus cannot use HTTP to fetch resources and cannot run system commands. As a result, JSON filters cannot be used, --embed-resources works only with resources that have been explicitly provided in the WASM sandbox, and PDFs cannot be produced (since that requires running external commands). However, Lua filters can be used, as long as they do not run system commands.

  A JavaScript bridge module, wasm/pandoc.js, is provided; this handles the setup necessary to run pandoc.wasm in a browser.

  In addition, a full-featured GUI interface is provided in the wasm subdirectory. make serve from that directory and it will run locally, or visit https://pandoc.org/app. Note that once the relevant code has been downloaded by the browser, it runs entirely in the browser, and the conversions never touch a server. The GUI was developed in interaction with Claude Code. This app includes a WASM version of Typst and can produce PDF output via Typst.

• Defaults files may now be either JSON or YAML (though a .yaml extension will still be assumed if the file has no extension). The structure of a JSON defaults file is isomorphic to that of a YAML defaults file.

• Variable expansion now works even for the defaults field of defaults files (#8024, Jacob Larkin).

• --extract-media will now create a zip archive containing the media (instead of a directory) if the path provided has a .zip extension.

• Processing with --citeproc is now affected by a reset-citation-positions class on headings. When the reset-citation-positions class is added to a top-level heading, --citeproc will reset position information at that point in the document. This is needed in order to ensure that the first citation in a chapter to a work that has been cited in a previous chapter will not be in abbreviated form.

• RST reader:

  • Fix definition lists where term ends with - (#11323). This reverts some old code giving special treatment to lines ending in hyphens; I don’t understand why it was there, because rst2html does not seem to do this.

• HTML reader:

  • Revert an earlier change that caused style tags in the body to be ignored (#10643, #11246).
  • Parse inline style elements as RawInline (#10643, #11246).

• Markdown reader:

  • Fix parsing of inline math ($...$) (#11311, benniekiss). Do not allow blank lines before closing $ delimiter. This brings the parser in line with the documentation.
  • Allow superscripted spans (#11409). These were being parsed as inline notes. Now we disallow an inline note followed by attributes, as this is almost certainly meant to be a span.
  • Support alerts extension for pandoc markdown (#9716). It is not enabled by default.

• MediaWiki reader:

  • Add behavior switches support (#11354, Anton Melnikov). They add a field to metadata without producing any text.
  • Handle non-recognized tags as plain text (#11299).
  • Better handling of inline tags (#11299). <mark>, <var>, <samp>, and <kbd> now produce Code or Span elements with classes, which can be handled by multiple output formats, instead of simply being parsed as raw HTML tags.

• RTF reader:

  • Ensure a new paragraph on \pard (#11361, Tuong Nguyen Manh). New paragraphs may start with \pard alone without an explicit paragraph break with \par preceding it.
  • Improve hyperlink parsing more (#10942, Tuong Nguyen Manh). Both the field instruction and its result may be ungrouped.
  • Fix bug where list items were incorporated into a following table (#11364).

• ODT reader:

  • Add table row and column spans (#11366, Tuong Nguyen Manh). Parse the number-rows-spanned and number-columns-spanned attributes to create Cells for the Table.

• DocBook reader:

  • Support “role” attribute (#11255, Yann Trividic). The role attribute is parsed and added to Pandoc AST elements, using a wrapper Div if needed.
  • Omit empty title when not required (#11422). This affects example and sidebar elements.
  • Fix adding wrong metadata (#11300, Tuong Nguyen Manh). Now keep track of the current element stack to only add metadata if inside an appropriate parent element.

• DocBook/JATS reader:

  • Don’t export surrounding space from inline elements (#11398). Previously we would export leading and trailing space inside elements like emphasis or ulink so they appeared outside the resulting pandoc Inline (Emph or Link). This is not really motivated; DocBook and XML in general treats leading and trailing whitespace in this context as significant.

• Docx reader:

  • Handle tables without tblGrid (#11380).
  • Look inside v:rect as well as v:shape (#11412).

• LaTeX reader:

  • Handle more quote macros from fontspec and ngerman babel (#6120).

• Org reader:

  • Don’t include ‘example’ class when parsing org example blocks (#11339). These are just unmarked code blocks.

• Texinfo writer:

  • Improve handling of certain code blocks (#11312). MediaWiki, for example, will parse a code block containing formatting as a sequence of Code elements separated by LineBreaks. For this we now use a texinfo example block.

• Typst writer:

  • Escape hyphens when needed (#11334).

• HTML writer:

  • Include all classes on highlighted code elements (#11423). Previously, only the language class was included, and the others were dropped.
  • Slide formats: Make . . . pause work in nested blocks (#7201, #7582).
  • For revealjs, add idiomatic highlight.js support (#11420, Claude Opus 4.5). When using --syntax-highlighting=idiomatic with reveal.js output, pandoc now generates HTML compatible with reveal.js’s built-in highlight.js plugin: Code blocks use <pre><code class="language-X"> format. The template loads highlight.js CSS, JS, and RevealHighlight plugin.

• Markdown writer:

  • Ensure that \ line breaks are used for commonmark.
  • Use setext for headers containing line breaks for commonmark (#11341).
  • Allow display math to start/end with space (#11384). This reverts to earlier < 3.7 behavior.
  • Properly handle tables with footers (#11416).

• JATS writer:

  • Fix XML output for nested figures (#11362, Albert Krewinkel). Subfigures are now wrapped inside a <fig-group> element. Furthermore, figure content that isn’t allowed as children of <fig> elements, such as raw text, gets wrapped in <p> elements to ensure schema-conforming XML.

• AsciiDoc writer:

  • Use doubled delims in more contexts (#11362). Also escape the # character.
  • Use a span with role for SmallCaps (#11374).
  • Export spaces inside delimited constructs like emph.

• Docx writer:

  • Skip directory entries when building media overrides (#11379, You Jiangbin). Pandoc’s docx writer was previously adding an <Override> for /word/media/ in [Content_Types].xml when the reference doc contains media, which violates OPC rules and causes Word to report corruption.
  • Refactor the monolithic writeDocx into a number of smaller functions (Claude Opus 4.5).
  • Replace generic XML traversal with direct path navigation (Claude Opus 4.5). Instead of using Data.Generics everywhere to traverse the entire XML tree when setting language attributes, navigate directly to the known path w:docDefaults/w:rPr/w:lang. This is more efficient and removes the dependency on Data.Generics.

• EPUB writer:

  • Don’t use footnote backlinks for EPUBv3. Here we use aside elements, which are popups, and the backlinks are not needed; in some readers they cause a redundant number to appear, since the reader adds a note number.

• MediaWiki writer:

  • Use Doc Text instead of Text for document construction (with Claude Open 4.5). This refactors the writer to use Text.DocLayout combinators (vcat, hcat, literal, blankline, cr, chomp) for building output, following the pattern used by other text format writers (RST, Markdown, Man). This enables better control over line spa...

pandoc 3.8.3

I'm pleased to announce the release of pandoc 3.8.3,
available in the usual places:

Binary packages & changelog:
https://github.com/jgm/pandoc/releases/tag/3.8.3

Source & API documentation:
http://hackage.haskell.org/package/pandoc-3.8.3

This release adds three new input formats (asciidoc, pptx, and
xlsx) and one new output format (bbcode + variants).

It fixes a number of bugs (including some regressions in 3.8).
See the changelog for full details.

API changes:

  + New exported module Text.Pandoc.Readers.AsciiDoc,
    exporting readAsciiDoc.
  + New module Text.Pandoc.Readers.Pptx, exporting readPptx.
  + New module Text.Pandoc.Readers.Xlsx, exporting readXlsx.
  + Text.Pandoc.Readers: Export readAsciiDoc, readXlsx, readPptx.
  + New module Text.Pandoc.Writers.BBCode, exporting
    writeBBCode,  writeBBCodeSteam, writeBBCodeFluxBB,
    writeBBCodePhpBB, writeBBCodeHubzilla, writeBBCodeXenforo.
  + Text.Pandoc.Writers: Export writeBBCode,
    writeBBCodeSteam, writeBBCodeFluxBB, writeBBCodePhpBB,
    writeBBCodeHubzilla, writeBBCodeXenforo .
  + Text.Pandoc.Writers.Shared: Export insertCurrentSpansAtColumn,
    takePreviousSpansAtColumn and decrementTrailingRowSpans.
  + Text.Pandoc.Shared: Export allRowsEmpty and
    tableBodiesToRows.

Thanks to all who contributed, especially new contributors
Anton Antich, and Asliddinbek Azizovich, and James Barlow.

Click to expand changelog

• Add asciidoc as an input format (#1456).

• Add xlsx (Microsoft Excel) as an input format (Anton Antich). Each worksheet turns into a section containing a table.

• Add pptx (PowerPoint) as new input format (Anton Antich).

• Add bbcode as a new output format (#11242, reptee). Several variants of BBCode are also supported: bbcode_fluxbb (FluxBB), bbcode_phpbb (phpBB), bbcode_steam (Hubzilla), bbcode_hubzilla (Hubzilla), and bbcode_xenforo (xenForo).

• New exported module Text.Pandoc.Readers.AsciiDoc, exporting readAsciiDoc [API change].

• New module Text.Pandoc.Readers.Pptx, exporting readPptx (Anton Antich) [API change].

• New module Text.Pandoc.Readers.Xlsx, exporting readXlsx (Anton Antich) [API change].

• LaTeX reader:

  • Revert \linebreak as LineBreak (#11272). \linebreak is more of a hint, it shouldn’t produce a hard break.
  • Better handling of \makeatletter in parsing raw LaTeX (#11270).
  • Fix spurious paragraph breaks in math environments (#11265, Emmanuel Ferdman). Previously, a math environment with extra space before the \end would get rendered with a blank line, which LaTeX treats as a paragraph break.
  • Change type on rawLaTeXParser in Text.Pandoc.LaTeX.Parsing. The preparser doesn’t need to return a value.
  • Fix rawTeXParser (#11253). Make macro expansion in raw LaTeX depend on the setting of the latex_macros extension. Previously macros were always expanded, even in raw TeX in markdown. In addition, there was previously a bug that caused content to be garbled in certain cases.
  • Handle ifstrequal at a lower level, like the other if commands (#11253).
  • Move ifstrequal, iftoggle, etc., which were misplaced in environments, to blockCommands, so these commands work properly.

• Docx reader:

  • Handle REF link instruction (#11296, Ezwal).
  • Check recursively for caption styles (Albert Krewinkel). The docx reader uses caption styles to identify figures and captioned tables. It now checks for known caption styles in the full styles hierarchy of a paragraph instead of just checking the style directly. This allows to recognize caption styles that are built on top of the basic caption style, as is sometimes the case in sophisticated styles.

• Markdown reader:

  • Fix performance issue in links with ' (#10880).

• Typst reader:

  • Handle document metadata and #title (jgm/typst-hs#80). Note that previously, the typst reader never returned document metadata. Now it does, even if the typst document does not contain a #title function that would result in actually printing the title block.

• Djot reader:

  • Add Space elements (#11250). Previously we just got big Str elements with spaces included. But many pandoc writers assume that breakable spaces will be Space elements, and this is also required for automatic wrapping.

• RST reader:

  • Correctly handle intraword emphasis (#11309).

• Text.Pandoc.Readers:

  • Export readAsciiDoc, readXlsx, readPptx [API change].

• New module Text.Pandoc.Writers.BBCode, exporting writeBBCode, writeBBCodeSteam, writeBBCodeFluxBB, writeBBCodePhpBB, writeBBCodeHubzilla, writeBBCodeXenforo [API change].

• LaTeX writer:

  • Make level 1-3 headings work inside blockquotes (#11281, James Barlow).
  • Remove split from list of math environments (#11274).
  • Improve handling of math environments in tex math (#11266).

• HTML writer:

  • Add reveal.js scroll and scrollSnap options to writer and template (#10052, Asliddinbek Azizovich).
  • Use ‘defer’ when including mathjax script, as recommended in MathJax docs (#11292).

• ANSI writer:

  • Apply row spans in tables (#10149, Tuong Nguyen Manh). The ANSI writer is now able to keep track of row spans and apply them in rows.

• Pptx writer:

  • Handle reference doc without slides (#7536, Tuong Nguyen Manh).

• AsciiDoc writer:

  • Add more table features (#11267, Tuong Nguyen Manh): Row span and column span, footer row, individual horizontal cell alignment.

• Typst template:

  • Fix font for compatibility with typst 0.14, which doesn’t permit an empty array for font (#11238).
  • Re-add columns to typst template (#11259), fixing a pandoc 3.8 regression.
  • Fix syntax for bibliography inclusion (#11233, Mickaël Canouil). Previously the syntax was wrong when multiple bibliography files were specified. Typst expects an array.

• Text.Pandoc.Writers:

  • Export writeBBCode, writeBBCodeSteam, writeBBCodeFluxBB, writeBBCodePhpBB, writeBBCodeHubzilla, writeBBCodeXenforo [API change].

• Text.Pandoc.Writers.Shared:

  • Add functions insertCurrentSpansAtColumn, takePreviousSpansAtColumn and decrementTrailingRowSpans for applying and keeping track of RowSpans over multiple rows (#10149, Tuong Nguyen Manh). [API change]

• Text.Pandoc.Logging:

  • Change message for missing HTML title warning (#11307). Suggest setting the pagetitle variable instead of setting title in metadata.

• Lua subsystem:

  • Preserve common state of custom Lua readers (Albert Krewinkel). The common state is transferred to Lua when calling a custom Lua reader, and is now also transferred back after the reader has finished. This ensures that info messages, warnings, and mediabag entries are available to the main program and all subsequent processing steps.

• Text.Pandoc.PDF:

  • Avoid converting SVG to PDF when non-TeX PDF engine is used (#11275). This fixes a 3.8 regression, which caused documents with SVGs to raise an error when converted to PDF using WeasyPrint.
  • Fix a 3.8 regression with typst and smart quotes (#11256). Before 3.8, the default behavior when producing a PDF -t typst was to produce smart quotes according to typst’s defaults. (This could be defeated by specifying -t typst-smart.) This behavior broke in 3.8 because of a change to Text.Pandoc.PDF. This change caused smart to be disabled for all formats when producing PDFs, when before it was only disable for TeX-based formats (to avoid bad ligatures). This commit restores the old behavior. Possibly the regression also other affects other non-TeX formats, e.g. HTML.

• Text.Pandoc.Shared:

  • Add functions allRowsEmpty and tableBodiesToRows from the RST writer for reuse in other writers. (Tuong Nguyen Manh) [API change].

• Text.Pandoc.Citeproc:

  • Allow formatting in locator to be transmitted to citeproc. We do this indirectly, by rendering the formatting using the HTML tags that citeproc recognizes. Fixes jgm/citeproc#68 and jgm/citeproc#163. Note that formatting is only possible for locators given in the explicit form, surrounded by curly braces. It won’t work for implicit locators, since these expect number-like expressions.

• New non-exported module Text.Pandoc.Readers.OOXML.Shared containing functions factored out from Text.Pandoc.Readers.Docx.Util (Anton Antich).

• Tests: The common file nativeDiff has been extracted from the Docx and Pptx text files and put in Tests.Helpers.

• Use asciidoc 0.1, djot 0.1.2.4, texmath 0.13.0.2, typst 0.8.1, citeproc 0.12.

• MANUAL.txt:

  • Improve implicit_figure documentation (#11082).
  • Give both forms of options when referring to them (#11306).

• Update INSTALL.md (#11271).

pandoc 3.8.2.1

I'm pleased to announce the release of pandoc 3.8.2.1,
available in the usual places:

Binary packages & changelog:
https://github.com/jgm/pandoc/releases/tag/3.8.2.1

Source & API documentation:
http://hackage.haskell.org/package/pandoc-3.8.2.1

This is primarily a bug-fix release. There are no API changes.

The main motivation for the release is to fix a serious performance
regression with --citeproc and the default CSL style,
chicago-author-date.csl. This style was recently revised in a way that
took much longer for citeproc to parse. This version of pandoc is
built with citeproc 0.11, which fixes the performance regression.

One new feature (added by Albert Krewinkel) is that the Org reader now
parses parameter lists on unknown blocks, and also supports dynamic
blocks.

Thanks to all who contributed, especially new contributors
Emmanuel Ferdman, FoxChillz, mourino, and priiduonu.

Click to expand changelog

• HTML reader: allow blank space between open and close iframe.

• RTF reader: improve hyperlink parsing (#11211).

• Org reader:

  • Parse parameter lists on unknown blocks (#11188, Albert Krewinkel). The reader tries to parse the rest of the opening line of a block, e.g., #+begin_myblock …, as a parameters list. It first assumes that the parameters are in lisp-style (:key value), then alternatively tries to read python-style key-value pairs (key=value) and falls back to reading the entire remaining line as a single parameter attribute.
  • Add support for dynamic blocks.

• Docx writer: properly handle nested comment spans (#8189, #6959, mourino).

• RST writer: Don’t use simple tables with RowSpans (#11214, Tuong Nguyen Manh).

• Typst writer: Escape open paren after non-space (#11210). This fixes an issue that occurs if an open paren comes right after e.g. #strong[test].

• Typst template: ensure that title block is properly centered (#11221).

• LaTeX writer/template: small fix for unnumbered tables for compatibility with older LaTeX installations (#11201). Thanks to @priiduonu for the solution.

• MANUAL.txt: Fixed missing backtick (#11209, FoxChillz).

• Correct anchor references to pandoc.text module documentation (#11111, Emmanuel Ferdman).

• Fixed golden test regeneration in Docx reader test.

• Allow unicode-data 0.8.

• Use citeproc 0.11. This fixes a significant performance regression in pandoc 3.8, which was due to a rewrite of the default chicago-author-date.csl file. Performance with --citeproc is now on par with what we had in pandoc 3.7, even with the revised Chicago styles.

pandoc 3.8.2

I'm pleased to announce the release of pandoc 3.8.2,
available in the usual places:

Binary packages & changelog:
https://github.com/jgm/pandoc/releases/tag/3.8.2

Source & API documentation:
http://hackage.haskell.org/package/pandoc-3.8.2

This release fixes a regression in the typst template (since 3.8), which caused links to be omitted.

It also adds a new default Markdown extension, `table_attributes`, which allows attributes to be added to tables by putting them after the caption.

API change: Add `Ext_table_attributes` constructor to Extension.

Thanks to all who contributed.

Click to expand changelog

• Markdown reader/writer: implement new table_attributes extension (#10884). When table_attributes is enabled (as it is by default for pandoc’s Markdown), attributes can be attached to a table by including them at the end of the caption. Previously the writer would emit an identifier in this position, but the reader didn’t handle it. Now arbitrary attributes are allowed, and they work in both the reader and writer.

• Typst writer: don’t add superfluous semicolons (#11196). Previously we added semicolons after inline commands not followed by spaces, but mainly this was to deal with one issue: the presence of a semicolon after an inline command, which would be swallowed as a command separator (#9252). This commits adopts an approach that should avoid so many superfluous semicolons: it escapes semicolons that might come right after a command.

• Typst template: fix 3.8 regression in which links disappear (#11194). A template change in 3.8 added a show rule for links which causes them to disappear except in special cases.

• Text.Pandoc.Parsing: rewrite oneOfStrings more efficiently.

• LaTeX writer: Fix strikeout in links (#11192, Tuong Nguyen Manh). As in #1294 \url and \href need to be protected inside an mbox for soul commands.

• Text.Pandoc.Extensions: Add Ext_table_attributes constructor for Extension [API change].

• Use released texmath 0.13.0.1.

• Update FSF contact information in COPYING (#11183, Bensun Muite).

• MANUAL.txt: remove some redundancy (#11178, Reuben Thomas).

pandoc 3.8.1

I'm pleased to announce the release of pandoc 3.8.1,
available in the usual places:

Binary packages & changelog:
https://github.com/jgm/pandoc/releases/tag/3.8.1

Source & API documentation:
http://hackage.haskell.org/package/pandoc-3.8.1

This release introduces a few new features and fixes some bugs
and regressions. Of special note:

- New output format vimdoc (for Vim documentation).
- --syntax-highlighting now works as expected for typst output.
- New shorthands variable allows activating babel shorthands
  in LaTeX/PDF output.
- Removed coloring for links in epub.css, so that the reader's
  defaults will be used.

API changes:

- New module Text.Pandoc.Writers.Vimdoc, exporting writeVimdoc.
- Text.Pandoc.Parsing: new functions tableWithSpans,
  tableWithSpans', toTableComponentsWithSpans, and
  toTableComponentsWithSpans'.
- Text.Pandoc.Shared: new function removeLinks.
- Text.Pandoc.Highlighting: export functions formatTypstBlock,
  formatTypstInline, styleToTypst (from skylighting).

Thanks to all who contributed, especially Tuong Nguyen Manh (who
has been working hard to improve table support) and new contributors
Raymond Berger and reptee.

Click to expand changelog

• New output format vimdoc (Vim documentation format) (#11132, reptee).

  • [API change] Added module Text.Pandoc.Writers.Vimdoc, exporting writeVimdoc.

• Markdown reader:

  • Improve superscript/subscript/inline note parsing (#8652). We do not allow inline notes to be followed by ( or [. Otherwise, we parse inline notes before superscripts. Also, the sub/superscript parsers have been adjusted so that they really exclude unescaped spaces (as they did not before, when the spaces occurred in nested inlines).
  • Fix simple table alignment (#11136, Tuong Nguyen Manh). Take wide characters into account when determining the alignment.

• LaTeX reader:

  • Ignore \pandocbounded (#11140).

• XML reader:

  • Parse <MetaString> (#11137, massifrg).

• Typst reader:

  • Add support for reading typst pagebreak (#11101, Raymond Berger). The pagebreak is parsed as a HorizontalRule inside a wrapper Div with class page-break.

• Docx reader:

  • Handle figures in indented paragraphs (#11028).
  • Change default for textwidth. This should only be used if sectPr is not found.
  • Properly calculate table column widths (#9837, #11147). Previously we assumed that every table took up the full text width. Now we read the text width from the document’s sectPr.
  • Use Tasty.Golden for Docx reader tests. This way we can update them with --accept.

• RST reader:

  • Fix regression in simple table parsing (#11150).
  • SkippedContent warning if table directive contains non-tabular content.
  • Simple tables: leading space in a cell should not cause the contents to be parsed as a block quote (#11146).
  • Parse :alt: on figure (#11140). Also give a better default if alt is not specified, using the stringified caption rather than the filename.
  • Support col spans for simple tables (Tuong Nguyen Manh).

• Markdown writer:

  • Improve handling of implicit figures (#11140). Allow implicit figures when alt text differs from caption (in this case, we use an image attribute to add the alt).
  • Use approximate pipe tables when it’s the only option (#11128). If we have a table with row/colspans that can rendered as an approximate pipe table (without row/colspans), and no other table format is enabled that could render the table, we fall back to an “approximate” pipe table, with no row/colspans.

• RST writer:

  • Ensure blank line before directives (#11162).
  • Add col spans for simple tables (#10127, Tuong Nguyen Manh).

• OpenDocument writer:

  • Add missing table elements (#10002, Tuong Nguyen Manh). Add missing header rows after the first one, footer rows as well as TableBody header rows.

• Docx writer:

  • Fix regression (from 3.8) in highlighted code (#11156).

• Powerpoint writer:

  • Handle single column (Tuong Nguyen Manh).

• Typst writer:

  • Fix syntax highlighting (#11171, completes #10525). Previously the native typst highlighting was always used, regardless of the setting of --syntax-highlighting. With this change, --syntax-highlighting=none and --syntax-highlighting=<stylename> (with skylighting style) will work.

• LaTeX writer:

  • Make beamer footnotes compatible with pauses (#5954). Previously they would appear before the content to which the note was attached, when there were pauses in a slide.
  • Avoid \_ in bibliography variable (#11152).
  • Ensure that unlabelled tables don’t increment counter (#11141).
  • Protect VERB in caption (#11139, Tuong Nguyen Manh).
  • Don’t add links to TOC (#11124, Albert Krewinkel).
  • Fix strikeouts in beamer title (#11168, Tuong Nguyen Manh).

• LaTeX template: Add shorthands variable for LaTeX output (#11160). If true, pandoc will allow language-specific shorthands when loading babel. (This is helpful, for example, in getting proper spacing around French punctuation.)

• epub.css: Remove coloring for a, a:visiting (#11174). This was causing links in iOS books app not to be distinguished in any way (since underlining is not used there).

• Text.Pandoc.Parsing:

  • [API chage] (Tuong Nguyen Manh). New functions tableWithSpans, tableWithSpans', toTableComponentsWithSpans and toTableComponentsWithSpans' take a list of lists of (Blocks, RowSpan, ColSpan) to parse a Table with different RowSpan and ColSpan values accordingly. New helper functions singleRowSpans and singleColumnSpans help set all RowSpans or ColSpans to be 1 in case the table format only allows setting one or the other.

• Text.Pandoc.Class:

  • Let fetchItem fail if the HTTP request is not successful (Albert Krewinkel). HTTP requests that don’t return a 200 error code are now treated as an error. This ensures that a warning is triggered when using --embed-resources or --extract-media.

• Text.Pandoc.Writers.Shared:

  • Add new function removeLinks [API change] (Albert Krewinkel). The function converts links to spans. It is used, for example, to avoid nested links. The HTML writer used to put the description of nested links into small caps, but uses a simple span now.

• Text.Pandoc.Highlighting: export typst functions [API change]. New exported functions formatTypstBlock, formatTypstInline, styleToTypst.

• Text.Pandoc.XML:

  • Add fetchpriority to list of HTML attributes (#11176).

• Allow unicode-data 0.7.

• Use released djot 0.1.2.3. Fixes a bug in which indentation was swallowed in a code block inside a blockquote.

pandoc 3.8

I'm pleased to announce the release of pandoc 3.8,
available in the usual places:

Binary packages & changelog:
https://github.com/jgm/pandoc/releases/tag/3.8

Source & API documentation:
http://hackage.haskell.org/package/pandoc-3.8

This release comes with many small improvements and a few larger ones.
Among the more visible changes:

+ A new input/output format xml, which exactly represents a pandoc
  AST in a more easily human-readable form than JSON. The format is
  documented in doc/xml.md, and schemas can be found in tools/pandoc-xml.*.

+ A new command line option --syntax-highlighting, which takes the
  values 'none', 'default', 'idiomatic', a style name, or a path to
  a theme file.  --no-highlighting and --highlight-style are deprecated.

+ New extensions smart_quotes and special_strings for org mode.
  These allow pandoc's parsing to more closely reproduce Emacs org-mode's
  behavior.

+ The old compact_definition_lists extension has been removed.

API changes:

+ New modules Text.Pandoc.Readers.XML (exporting readXML) and
  Text.Pandoc.Writers.XML (exporting writeXML).

+ Text.Pandoc.Extensions: added constructors Ext_smart_quotes,
  Ext_special_strings; removed Ext_compact_definition_lists.

+ Text.Pandoc.App now exports versionInfo, a function that takes
  three parameters that can be filled in by pandoc-cli.

+ Text.Pandoc.Parsing: tableWith and tableWith' now return
  a list of lists of Blocks, allowing for multiple header rows.

+ Text.Pandoc.ImageSize: Add Point and Pica as constructors of
  ImageSize.  Add Avif constructor of ImageType.

+ Text.Pandoc.Class: CommonState is now opaque and does not support
  its fields.  To compensate for this, we now export several
  new functions: getRequestHeaders, setRequestHeaders, getSourceURL,
  getTrace.

Thanks to all who contributed, especially new contributors
Christopher Kenny, Erik Post, Repetitive, Reuben Thomas, Ryan Gibb,
Sean Soon, and massifrg.

Click to expand changelog

• Add a new input and output format xml, exactly representing a Pandoc AST and isomorphic to the existing native and json formats (massifrg). XML schemas for validation can be found in tools/pandoc-xml.*. The format is documented in doc/xml.md. Pandoc now defaults to this reader and writer when the .xml extension is used.

  Two new exported modules are added [API change]: Text.Pandoc.Readers.XML, exporting readXML, and Text.Pandoc.Writers.XML, exporting writeXML. A new unexported module Text.Pandoc.XMLFormat is also added.

• Add a new command line option --syntax-highlighting; this takes the values none, default, idiomatic, a style name, or a path to a theme file. It replaces the --no-highlighting, --highlighting-style, and --listings options, which will still work but with a deprecation warning. (Albert Krewinkel)

• Create directory of output file if it doesn’t exist (#11040).

• Update --version copyright dates (#10961), and use a hardcoded string “pandoc” for the program name in --version, per GNU guidelines.

• Add smart_quotes and special_strings extensions (Albert Krewinkel). Currently these only affect org. Org mode makes a distinction between smart parsing of quotes, and smart parsing of special strings like .... The finer grained control over these features is necessary to truthfully reproduce Emacs Org mode behavior. Special strings are enabled by default, while smart quotes are disabled.

• Remove the old compact_definition_lists extension. This was neded to preserve backwards compatibility after pandoc 1.12 was released, but at this point we can get rid of it.

• Make -t chunkedhtml -o - output to stdout (as documented), rather than creating a directory called - (#11068).

• RST reader: Support multiple header rows (#10338, TuongNM).

• LaTeX reader:

  • Support soft hyphens (Albert Krewinkel).
  • Parse \minisec as unlisted level 6 headings (#10635, Albert Krewinkel).
  • Support \ifmmode (#10915).
  • Change handling of math environments (#9711, #9296). Certain environments in LaTeX will trigger math mode and can’t occur within math mode: e.g., align or equation. Previously we “downshifted” these, parsing an align environment as a Math element with aligned, and an equation environment as a regular display math element. With this shift, we put these in Math inlines but retain the original environments. texmath and MathJax both handle these environments well.

• Typst reader:

  • Fix addition of image path prefix to use posix separator.
  • Properly resolve image paths in included files (#11090).
  • Handle inline-level show rules on block content (#11017). Typst allows things like smallcaps to be applied to block-level content like headings. This produces a type mismatch in pandoc, so before processing the output of typst-hs, we transform it, pulling the block-level elements outside of the inline-level elements.

• Org reader:

  • Improve sub- and superscript parsing (Albert Krewinkel). Sub- and superscript must be preceded by a string in Org mode. Some text preceded by space or at the start of a paragraph was previously parsed incorrectly as sub- or superscript.
  • Allow “greater block” names to contain any non-space char (#4287, Albert Krewinkel).
  • Accept quoted values as argument values (#8869, Albert Krewinkel).
  • Recognize “fast access” characters in TODO state definitions (#10990, Ryan Gibb).
  • Improve org-cite parsing: Handle global prefix and suffix properly. Use all and only the styles mentioned in oc-basic.el. Allow space after ;.

• HTML reader:

  • Don’t drop the initial newline in a pre element (#11064).

• DocBook reader:

  • Add rowspan support (#10981, Sean Soon).
  • Be sensitive to startingnumber attribute on ordered lists (#10912).

• POD reader:

  • Fix named entity lookup (#11015, Evan Silberman).

• Man reader:

  • Support header and footer reader (Sean Soon).

• Markdown reader:

  • Don’t confuse a span after an author-in-text citation with a locator. E.g. @foo [test]{.bar}. See #9080 (comment).
  • Make definition lists behave like other lists (#10889). If the four_space_rule extension is not enabled, figure out the indentation needed for child blocks dynamically, by looking at the first nonspace content after the : marker. Previously the four-space rule was always obeyed.
  • Fix tight/loose detection for definition lists, to conform to the documentation.

• ODT reader:

  • Support table-header-rows (Tuong Nguyen Manh).

• Docx reader:

  • Don’t add highlighting if highlight color is “none” (#10900).
  • Handle strict OpenXML as well as transitional (#7691).
  • Fix stringToInteger (#9184). It previously converted things like 11ccc to an integer; now it requires that the whole string be parsable as an integer.
  • Improve handling of AlternateContent. This fixes handling of one representation of emojis in Word (#11113).

• LaTeX writer:

  • Control figure placement with attribute (#10369, Sean Soon). If a latex-placement attribute is present on a figure, it will be used as the optional positioning hint in LaTeX (e.g. ht). With implicit figures, latex-placement will be added to the figure (and removed from the image) if it is present on the image.
  • Include cancel package only if there is math that contains \cancel, \bcancel, or \xcancel.
  • Add braces around comments in title-meta (#10501). This is needed to prevent PDFs from interpreting this as a sequence of titles.
  • Set pdf-trailer-id if SOURCE_DATE_EPOCH envvar is set (#6539, Albert Krewinkel). The SOURCE_DATE_EPOCH environment variable is used to trigger reproducible PDF compilation, i.e., PDFs that are identical down to the byte level for repeated runs.
  • Be more conservative about using \url (#8802). We only use it when the URL is all ASCII, since the \url macro causes problems when used with some non-ASCII characters.
  • Support soft hyphens (Albert Krewinkel).
  • Change handling of math environments (#9711, #9296). When certain math environments (e.g. align) are found in Math elements, we emit them “raw” instead of putting them in $..$.

• Typst writer:

  • Check XID_Continue in identifiers (Tuong Nguyen Manh).
  • Add escapes to prevent inadvertent lists due to automatic wrapping (#10047). Also simplify existing code that was meant to do this.
  • Add parentheses around typst-native year-only citations (#11044).
  • Add native Typst support for nocite (#10680, Albert Krewinkel). The nocite metadata field can now be used to supply additional citations that don’t appear in the text, just as with citeproc and LaTeX’s bibtex and natbib.
  • Set lang attribute in Divs (#10965).
  • Rename numbering variable to section-numbering (Albert Krewinkel). This is the name expected by the default template.
  • Add support for custom and/or translated “Abstract” titles (Albert Krewinkel, #9724).

• Org writer:

  • Don’t wrap link descriptions (#9000). Org doesn’t reliable display these as links if they have hard breaks.
  • Disable smart quotes by default (Albert Krewinkel).

• Markdown writer:

  • Better handling of pandoc-generated code blocks (#10926). Omit the wrapper sourceCode divs added by pandoc around code blocks. More intelligently identify which class to use for the one class allowed in GFM code blocks. If there is a class of form language-X, use X; otherwise use the first class other than sourceCode.
  • Use fenced divs even with empty attributes (#10955, Carlos Scheidegger). Previously fenced divs were not used in this case, causing the writer to fall back to raw HTML.
  • Match indents in definition items (#10890, Albert Krewinkel). Previously, the first line of a defini...

pandoc 3.7.0.2

I'm pleased to announce the release of pandoc 3.7.0.2,
available in the usual places:

Binary packages & changelog:
https://github.com/jgm/pandoc/releases/tag/3.7.0.2

Source & API documentation:
http://hackage.haskell.org/package/pandoc-3.7.0.2

This release fixes some regressions in grid table rendering introduced
in 3.7. There are a few other nice improvements as well; see the
changelog for details.

Thanks to all who contributed, especially new contributor GHyman83.

Click to expand changelog

• RST writer:

  • Don’t emit alignment markers in grid tables (#10857).

• Asciidoc writer:

  • Add support for sidebars (GHyman83).

• LaTeX writer:

  • Include alt option in \includegraphics (#6095).

• Markdown writer:

  • Preserve figure attributes (Nikolay Yakimov, #10867). Fixes a regression introduced by 0d2114e, which caused the Markdown writer to ignore attributes on the figure if it has class or key-value attributes set.

• HTML writer:

  • Use the ID prefix in the ID for the footnotes section (Benjamin Esham).

• Text.Pandoc.Writers.Shared:

  • gridTable: fix (3.7) regression with missing cell alignments (#10853).
  • gridTable: fix headings with colspans (#10855). If the heading contains a colspan, we still need to include information in the header line about the colspecs.
  • gridTable: fix headerless tables. The top line should encode colspan information.

• Text.Pandoc.SelfContained:

  • Fix handling of empty script element (#10862). Previously in this case the closing tag was dropped.
  • Do not drop data- attributes in script tags (#10861).

• Lua subsystem (Albert Krewinkel):

  • Add function pandoc.mediabag.make_data_uri (#10876). The function takes a MIME type and raw data from which it creates an RFC 2397 data URI.

• tools/update-lua-module-docs: fix handling of wikilinks (Albert Krewinkel).

• doc/lua-filters.md: add missing docs for pandoc.Caption (Albert Krewinkel).

• Require texmath 0.12.10.3, typst 0.8.0.1

pandoc 3.7.0.1

I'm pleased to announce the release of pandoc 3.7.0.1,
available in the usual places:

Binary packages & changelog:
https://github.com/jgm/pandoc/releases/tag/3.7.0.1

Source & API documentation:
http://hackage.haskell.org/package/pandoc-3.7.0.1

This release fixes some serious problems with the new grid table writer
introduced in 3.7. If you installed 3.7, I recommend you upgrade.

It also fixes tagging with -t context+tagging.

Click to expand changelog

• Text.Pandoc.Shared.Writer: Fix numerous problems with gridTable and add tests (#10848). These fixes affect the Markdown, RST, and Muse writers.

• Fix context writer/template to produce tagged PDFs (#10846). As before, the tagging extension must be enabled. We now add the command that tells ConTeXt to start tagging.