SiameseScribe

No preview image was uploaded (this is optional).

Study program: Creative Computing
Lecture: MLAB-AAI PA bcc_23w VZ SS2026
Lecturer(s): Djordje Slijepčević
Team leader: Tiffany Müller
Team members:

Jakob Huber (cc231025)
Raphael Schmidt (cc231040)
Aleksandar Miloradovic (cc231051)
Tiffany Mller (cc231058)
Franz-Steven San-Diego (cc231074)
Christina Wu (cc231075)

Short description: SiameseScribe is a web-based workbench where art historians search for similar pen flourishes (Fleuronnée) in medieval manuscripts, and the model gets sharper each time an expert marks a match right or wrong.

Project description:

SiameseScribe is a web-based workbench that helps art historians compare pen flourishes (Fleuronnée), the decorative pen-drawn ornaments found in medieval manuscripts, usually marking where a page or section begins. Once enough manuscripts get digitized, going through these ornaments by hand stops being realistic, so the tool takes over the matching work. It uses metric learning to find visually similar flourishes, and experts steer it through feedback, no coding needed. Two flourishes differ less in their overall shape than in small repeated motifs like loops, spirals, and palmettes, so the model is trained to pick up on those local details. Upload a flourish and the system breaks it into smaller patches, then pulls up the closest matches from its collection. Reviewers mark each result as similar or not, and over time the model shifts toward their judgement, learning what a real match looks like to a human eye.