YAML parser swallows a single character when Unicode is used

[greg-at-moderne]

What version of OpenRewrite are you using?

Current main = 27f7bd7

What is the smallest, simplest way to reproduce the problem?

The following unit test case:

    @Test
    void unicodeCharacters() {
        rewriteRun(
          yaml(
              """
                - name: Autobuild
                # 📚COMMENT
                - name: Perform CodeQL Analysis
              """)
        );
    }

in rewrite-yaml

fails with:

  - name: Autobuild
  # 📚COMMENT
- - name: Perform CodeQL Analysis
+ - ame: Perform CodeQL Analysis

Context

• Extracted from real-life: https://github.com/jenkinsci/dimensionsscm-plugin/blob/510dc415363a64fb6334ebba4f9a1cd318010efe/.github/workflows/codeql-analysis.yml
• Likely somehow related to: Fixing YAML handling of multiline literals in some cases #4924 as it had similar symptoms

[knutwannheden]

I analyzed this problem at some point. I can try to dig out what I found if necessary.