Adam Hodgen d73bb2633c LibWeb: Implement tokenization newline preprocessing ...

Newline normalization will replace \r and \r\n with \n.

The spec specifically states
> Before the tokenization stage, the input stream must be preprocessed
> by normalizing newlines.
wheras this is implemented the processing during the tokenization
itself.

This should still exhibit the same behaviour, while keeping the
tokenization logic in the same place.

2022-02-21 16:31:45 +01:00

108 KiB

Raw Blame History

View Raw