Skip to content

Ref tags with slash - #386

Merged
AngledLuffa merged 2 commits into
WikiExtractor:masterfrom
AngledLuffa:ref_tags_with_slash
Aug 2, 2026
Merged

Ref tags with slash#386
AngledLuffa merged 2 commits into
WikiExtractor:masterfrom
AngledLuffa:ref_tags_with_slash

Conversation

@AngledLuffa

Copy link
Copy Markdown
Collaborator

If a ref tag has a slash in quoted attributes - or even a > apparent closing tag - this should not actually terminate the processing of the tag. For example, there are legitimate tags which look like

<ref name="brecorder/12feb2012">

throughout various datasets, this example coming from SKR. These tags should be processed the same as any other ref tag.

With the help of Claude, this change extends the tag matching regex to allow for / or > in quoted attributes.

…n't close the whole tag (it was missing <ref> tags in SKR, for example)
… the closing > in quotes should not close the whole tag
@AngledLuffa
AngledLuffa merged commit f2a03ce into WikiExtractor:master Aug 2, 2026
@AngledLuffa
AngledLuffa deleted the ref_tags_with_slash branch August 2, 2026 03:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant