sean | 2 Mar 2011 18:17
Favicon

How to find tokens inside strings?

Sorry for posting to the bug list.  Is there a support forum I could use
instead?

Anyway,
I'm looking for a way to have idutils identify tokens inside strings.  It
seems to work for strings with one word but not for strings with multiple. 
For example, in:

const char* str = "string";

xtokid finds the token "string";

But in:

const char* str = "string with multiple words";

xtokid finds nothing.  Is there a way to have it find each individual word
in that string?

Thanks.
Sean
Jim Meyering | 7 Mar 2011 15:33
Gravatar

Re: How to find tokens inside strings?

sean@... wrote:
> Sorry for posting to the bug list.  Is there a support forum I could use
> instead?

This mailing list is the place for questions as well as bug reports.

> Anyway,
> I'm looking for a way to have idutils identify tokens inside strings.  It
> seems to work for strings with one word but not for strings with multiple.
> For example, in:
>
> const char* str = "string";
>
> xtokid finds the token "string";
>
> But in:
>
> const char* str = "string with multiple words";
>
> xtokid finds nothing.  Is there a way to have it find each individual word
> in that string?

Not that I see.
Jim Meyering | 20 Mar 2011 10:55
Gravatar

FYI, misc build/maint/tests patches:


From fbadd79a7a789e36cf398929ec17f6dbc7f77ede Mon Sep 17 00:00:00 2001
From: Jim Meyering <meyering@...>
Date: Mon, 3 Jan 2011 21:59:17 +0100
Subject: [PATCH 1/8] build: update gnulib submodule to latest

---
 gnulib |    2 +-
 1 files changed, 1 insertions(+), 1 deletions(-)

diff --git a/gnulib b/gnulib
index 9f0cd59..a2e8447 160000
--- a/gnulib
+++ b/gnulib
 <at>  <at>  -1 +1  <at>  <at> 
-Subproject commit 9f0cd590f76f5e5e942fbd90b253c90ca7c80699
+Subproject commit a2e8447d6b8abe23504f4f2d4757a60a2e8bee54
--
1.7.4.1.499.g53f9

From 9de5c91f05c8e04bb3aec26dd29f72a32bdb6b46 Mon Sep 17 00:00:00 2001
From: Jim Meyering <meyering@...>
Date: Mon, 3 Jan 2011 22:02:51 +0100
Subject: [PATCH 2/8] maint: update copyright year ranges to include 2011

Run "make update-copyright".
---
 NEWS                      |    2 +-
 README-hacking            |    2 +-
 bootstrap                 |    2 +-
(Continue reading)


Gmane