Space as a token

Development
1

Dear LT team,
Is there any way to capture space as a token???
E.g.,
language tool
token 1: language
token 2 regexp=‘yes’: \s
token 3: tool

2

Have you checked whether <regexp> helps? Development Overview - LanguageTool Wiki

3

Yes… But I am trying for POS tagging too.
Same example with pos tagging:
E.g., language tool
token 1: postag='NN’
token 2 regexp=‘yes’: \s
token 3: postag='NN’
Please let me know the solution…

4

You could try <token spacebefore="yes" postag="NN"></token>

1 Like
5

Thank you for your answer. Is there any way to highlight both space and NN
e.g.,
language tool



langauge**( tool)** —> to highlight space and tool
Thanks in advance

6

You can use <marker>...</marker> around the tokens you want to be highlighted.

7

It highlights the word only, not the space before the word…