Andrew Kaster 77718c0a66 LibWeb: Implement the Data state for the Swift tokenizer ...

And add tests! This implementation closely follows the current C++
implementation, replacing macros and gotos with a slightly more
complex state machine. It's very possible that an async version that
yields tokens on "emit" would be even simpler, but let's get this
one working first :).

2024-08-29 06:31:25 +02:00

3.6 KiB

Raw Blame History

View Raw