There are many deficiencies about gpb HOT 6 CLOSED

For input data validation, you might want to try the verify option.

Here's an example trying to encode -1 for an unsigned int:

$ cat m.proto
syntax='proto3';
message Msg { uint32 f = 1; }
$
$ erl
1> gpb_compile:file("m.proto", [maps,{verify,always}]).
...
3> m:encode_msg(#{f => -1}, 'Msg').
m:encode_msg(#{f => -1}, 'Msg').
** exception error: {gpb_type_error,{{value_out_of_range,uint32,unsigned,32},
                                     [{value,-1},{path,"Msg.f"}]}}
     in function  m:mk_type_error/3 (m.erl, line 353)
     in call from m:v_msg_Msg/3 (m.erl, line 332)
     in call from m:encode_msg/3 (m.erl, line 70)

For range checking for the output data, I'm not sure I follow. Could you explain more what you mean by this?

from gpb.

$ cat ts.proto
import "t1.proto"
message video_c
{
required uint32 id = 1; // id
optional bytes name = 2; // name
repeated uint32 terms = 3; // terms
}

Administrator@PC-20170610DFEC MINGW64 /g/zzwz/proto/gpb (master)
$ erl -pa ebin
Eshell V8.3 (abort with ^G)
1> ts:decode_msg(<<>>, video_c).
{video_c,undefined,undefined,[]}
2>

from gpb.

Another problem is that the generated code is too redundant, especially when a file is referenced multiple times, and there are N copies of the parsing code for that file.I don't know if there's a solution out there.

from gpb.

I assume you did expect some kind of decoding error when the binary is missing required fields? Maybe that is a good addition, but it would need to be enabled by an option for backwards compatibility.

... too redundant when a file is referenced multiple times...

There is no option to generate one .erl per .proto. Some redesign would be needed for that. Some areas that may need thinking is extend and (proto3) defaults.

Is your case that you have a few top-level .proto, some 2nd-level .protos that are imported from the top-levels, and some 3rd or deeper level .protos? If so, do you generate .erls for all of these? If yes, then maybe you could reduce the overhead of duplication by generating only for the top-level .protos.

from gpb.

thank you

from gpb.

In 4.18.0, which i just pushed, I added an option, verify_decode_required_present (cmd-line: -vdrp) for generating code that checks that required fields are present in the input binary to decode, so I'm closing this issue. If there's anything more, feel free to re-open or open another issue.

from gpb.