topic Re: How do I use Regex substitution? in Discussions

How do I use Regex substitution?

lala — Thu, 08 Jun 2023 16:39:36 GMT

Replaces the specified "(" with a newline character and removes all non-Chinese and non-numeric characters.

d试1(-是23(a文字789(+内c容4$3

txt="d试1(-是23(a文字789(+内c容4$3";

na=Regex(txt,  ？？ );

Thanks!

Re: How do I use Regex substitution?

Craige_Hales — Tue, 31 Jan 2023 14:58:18 GMT

use two statements. I added some extra problem characters to your example...

txt = "d试1(-是2^3([a]文/字789(+内\c容4$3";
step1 = Regex( txt, "\(", "\!n", globalreplace );
step2 = Regex( step1, "[-+/\\^$[\]a-zA-Z]", "", globalreplace );

The ( needs to be regex-escaped for step1. The newline is JSL-escaped.

For step2, the syntax of the [...] is complicated:

start with the - because without a leading character it can't be a range like a-z. (Otherwise it needs a regex-escape, \- )
the \ needs to be regex-escaped
the ] needs to be regex-escaped

Be careful not to accidentally write the JSL-escape \[ which changes the way JSL interprets strings. This is likely to happen when working with character sets in [...] if you don't know it will be a problem.

Notice the sequence [\]. It is not a character set. It is 2 characters that are in a character set.

Re: How do I use Regex substitution?

lala — Tue, 31 Jan 2023 23:46:52 GMT

Thank Craige!

I'll just use EmEditor to re replace

Re: How do I use Regex substitution?

lala — Wed, 01 Feb 2023 10:14:04 GMT

Thank Craige!

If I want to take this re substitution one step further: insert tabs between the Chinese characters and the data (set the Chinese characters in the original text to the left and the numbers to the right), to achieve a table that can input the result of the substitution directly into the JMP:
How do you need to change the code?

txt = "d试1(-是2^3([a]文/字789(+内\c容4$3";
step1 = Regex( txt, "\(", "\!n", globalreplace );//？？
step2 = Regex( step1, "[-+/\\^$[\]a-zA-Z]", "", globalreplace );//？？

s = N Items( step2 );
dt = New Table( "A", Add Rows( s ), New Column( "txt", Character, "Nominal" ), New Column( "num" ) );
dt[0, 0] = step2;

Re: How do I use Regex substitution?

Craige_Hales — Wed, 01 Feb 2023 12:03:48 GMT

This is an example for negative look behind and positive look ahead, lookaround. Step 3 is using both.

(?<!\d)

matches a single character that is not a digit just before the current zero-length position.

(?=\d)

matches a single character that is a digit just after the current zero-length position.

The tab character is inserted into the zero-length position to separate the non-digit from the digit.

txt = "d试1(-是2^3([a]文/字789(+内\c容4$3";
// change paren to newline...
step1 = Regex( txt, "\(", "\!n", globalreplace );
// remove unwanted characters - + / \ ^ $ [ ] a..z A..Z
step2 = Regex( step1, "[-+/\\^$[\]a-zA-Z]", "", globalreplace );
// insert tab when character before is not a digit and character after is a digit
step3 = Regex( step2, "(?<!\d)(?=\d)", "\!t", globalreplace );
// add header
step4 = "aaa\!tbbb\!n" || step3;
// import the string without making a file on disk
Open( Char To Blob( step4 ), "text" );

tabs separate fields

Re: How do I use Regex substitution?

lala — Wed, 01 Feb 2023 12:09:13 GMT

Thank Craige!

Look at the code you write, a real enjoyment!

Re: How do I use Regex substitution?

lala — Wed, 01 Feb 2023 12:10:41 GMT

It can't learn these advanced techniques in a script guide.

Re: How do I use Regex substitution?

Craige_Hales — Wed, 01 Feb 2023 12:28:58 GMT

Thanks!

It is hard to make good examples for some features in regex. This is a good example for lookaround. I think I could do it without lookaround, but it would be more complicated. @shannon_conners for the doc team: using positive and negative, ahead and behind, together, is what makes this compact and expressive (with a comment). It is an unusual situation, not mainstream usage.

Re: How do I use Regex substitution?

lala — Wed, 01 Feb 2023 12:49:12 GMT

Thank Craige!

I'd like to ask you a question about the underlying application:
I want to use JSL to solve more usage, can not use python and other tools.
Of course, I learned all of the JSL code from the many experts in this community.

My request is specifically:

how to restore protobuf(Google Protocol Buffe)-formatted binary text to JMP text ues JSL.

Re: How do I use Regex substitution?

lala — Wed, 01 Feb 2023 12:59:39 GMT

Like C# code coding code, how can you modify JSL?

I did not succeed in rewriting it.

Thanks!

h = [=> ];
u = "http://ds.m.emoney.cn/pick";
h["X-Protocol-Id"] = "8900";
h["X-Request-Id"] = "null";

b = Char To Blob( "~0A~0D~E5~BD~93~E6~97~A5~42~E7~82~B9~E8~82~A1~10~F2~DF~D2~09", "ascii~hex" );
rs = New HTTP Request( URL( u ), Method( "POST" ), JSON( b ), Headers( h ) );
rr = rs << Send;

Re: How do I use Regex substitution?

lala — Wed, 01 Feb 2023 13:05:26 GMT

This is just the general outline.

The main problem is to solve how to write request parameters correctly in JSL.

Re: How do I use Regex substitution?

Craige_Hales — Wed, 01 Feb 2023 13:04:34 GMT

Interesting https://developers.google.com/protocol-buffers/docs/overview

It looks like you have two choices: write your own https://github.com/protocolbuffers/protobuf/blob/master/docs/third_party.md which would then work for many protocols,

or, easier and harder,

pick an existing one and translate. I have not looked at it, but I might try starting with a JAVA version and translate that to JSL. But then you get to repeat the translation for the next protocol.

It would be a pretty cool project to make a translator. I do not plan to do that.

Re: How do I use Regex substitution?

lala — Wed, 01 Feb 2023 13:11:13 GMT

Thank you so much Craige!

I know it's a very difficult job.Thank you for writing a general framework, I will try to learn more knowledge to modify.Thank you for your efforts.