pw_tokenizer: Test tokenizing within a lambda
pw_tokenizer: Test tokenizing within a lambda

Change-Id: Ifbe337ec44b3c77ed17136f78a97e405a876ea73
Reviewed-on: https://pigweed-review.googlesource.com/c/pigweed/pigweed/+/93120
Commit-Queue: Auto-Submit <14637eda5603879df170705285bf30f5996692f0@pigweed.google.com.iam.gserviceaccount.com>
Pigweed-Auto-Submit: Wyatt Hepler <cca3bedb37979eacd157a9bceb473582df8aea1e@google.com>
Reviewed-by: Erik Gilling <1100d3bbb092e6691a138903fe8ea324306d03ea@google.com>

google/pigweed,google/pigweed,google/pigweed,google/pigweed,google/pigweed,google/pigweed,google/pigweed,google/pigweed,google/pigweed,google/pigweed