[H-GEN] awk and unicode on mac osx (bsd)

[Raymond Smith]

On Thu, Oct 20, 2005 at 11:35:42AM +1300, johannes at paradise.net.nz wrote:
> Perhaps, this was asked before, however, googling does not reveal too 
> much though.
> 
> Some time ago I  wrote a bunch of scripts under linux to filter ad 
> content in e-mail. Works just fine by piping e-mail through awk 
> scripts. Now I want to use the same scripting principle under bsd on 
> osx and had to find that e-mail is kept in unicode.
> 
> Does anyone know how to process unicode (e.g. utf_8) instead of plane 
> text with awk?
 
For GNU Awk, it seems to be a matter of setting your locale although
the manual at [1] says support is 'not perfect'. Maybe something 
similiar will work for the BSD?

HTH,

Raymond
[1] http://www.gnu.org/software/gawk/manual/gawk.html
-- 
raymond at humbug.org.au