kudo / react-native-js-benchmark Goto Github PK

JavaScript Engine Benchmark for React Native

License: MIT License

JavaScript 6.19% Python 21.15% Java 33.65% Starlark 4.96% TypeScript 4.85% HTML 5.56% CSS 1.49% Ruby 0.14% Makefile 3.96% C++ 18.05%

react-native v8 javascriptcore

react-native-js-benchmark's Introduction

JavaScript Engine Benchmark for React Native

Benchmark Results

RN 0.62.2, JSC 250230, V8 8.0, Hermes 0.4.1

RN 0.60.3, JSC 245459, V8 7.5.1, Hermes 0.1.0

These benchmarks ran on Samsung Galaxy Note 5

Benchmarks

React Rendering

RenderComponentThroughput

The series of test cases aim to measure how many React component could be rendered within some intervals.
- RenderComponentThroughput 10s
- RenderComponentThroughput 60s
- RenderComponentThroughput 180s
The reason that have different interval is that to assume JIT will start to work after longer repetitive executions.

Higher result is better

TTI (Time-To-Interaction)

The series of test cases aim to measure how long JS engine parse and evaluate the scripts. TTI time is from the content_appear_view_time - before_start_ReactInstanceManager_time. In different test cases, we try to generate different size of JS bundle and compare if size matters.

TTI ~3 MiB bundle
TTI ~10 MiB bundle
TTI ~15 MiB bundle

APK Size

Simply the comparion of library binary size and final APK size.

How to Run the Benchmark

Prerequisites:

macOS 10.14 (Other macOS versions or Linux might be supported, but I don't verify that)
Python 3
Node 8+

Simply to run

python start.py -a

Disclaimer

This project is specific to measure JS engine performance for React Native. It is not designated to do generic JS engine comparison.

For example, on React Native Android, we don't enable all JIT tiers on JavaScriptCore. On V8, I am currently trying to use the JIT-less mode. What I am trying to do is balancing between good enough performance, low memory usage, and small binary size. That is why to disable JIT sometimes.

react-native-js-benchmark's People

Stargazers

Watchers

Forkers

nparashuram codyi96 linchangjian salvoravida bojie-liu blackmatrix2007

react-native-js-benchmark's Issues

add bundle size

can you please add APK bundle size?

Add Hermes to the list of comparisons

Update hermes

Hi!
Hermes version in benchmark is a little outdated - v0.1
Can you update it to the actual (0.4) version?

Could you please update benchmark comparisons?

Hi, and really thanks for your great job,
Could you please update the results with latest engines?
Thanks.

Feature request: Recent JSC versions

I know that Intl prevents you/us from publishing a newer version of JSC for react-native, but it would be quite interesting to see how much the difference is between the one shipping in RN and an up to date version with Intl.

Remove dependency on colorful

For folks who may not have colorful installed, running this seems to give and error. Does this really need colorful as a dep ?

P.S: Please feel free to close this issue since this is only a nit, and i ran into this when I tried the repo.

Crash when launching RNBenchmark JSC

Description

I want to get some test data through this script, but the program seems to have no response😥:

$ python3 start.py -a

#############################################
# Config
#############################################

---------------------------------------------
ABIs: armeabi-v7a
---------------------------------------------

JSC version: 245459.0.0
Meta: Baseline JIT (but not x86), WebKitGTK 2.24.2
Intl: False
JSC binary size:
	armeabi-v7a: -1 MiB


V8 version: 7.5.1
Meta: JIT-less (but not arm64-v8a), V8 7.5.288.23
Intl: True
V8 binary size:
	armeabi-v7a: -1 MiB


Hermes version: 0.1.0
Meta: JIT-less, bytecode precompile
Intl: False
Hermes binary size:
	armeabi-v7a: 1.16 MiB


#############################################
# RenderComponentThroughput Suite
#############################################

---------------------------------------------
RenderComponentThroughput 10s
---------------------------------------------

There are two application had been installed on my device by the Benchmark. However, one of them called RNBenchmark JSC crashed when it is running. I caught some information that might be useful:

2019-11-05 21:23:10.323 28674-28694/? E/SoLoader: couldn't find DSO to load: libhermes.so
    
    --------- beginning of crash
2019-11-05 21:23:10.323 28674-28694/? E/AndroidRuntime: FATAL EXCEPTION: create_react_context
    Process: com.rnbenchmark.jsc, PID: 28674
    java.lang.UnsatisfiedLinkError: couldn't find DSO to load: libhermes.so
        at com.facebook.soloader.SoLoader.doLoadLibraryBySoName(SoLoader.java:738)
        at com.facebook.soloader.SoLoader.loadLibraryBySoName(SoLoader.java:591)
        at com.facebook.soloader.SoLoader.loadLibrary(SoLoader.java:529)
        at com.facebook.soloader.SoLoader.loadLibrary(SoLoader.java:484)
        at com.facebook.hermes.reactexecutor.HermesExecutor.<clinit>(HermesExecutor.java:20)
        at com.facebook.hermes.reactexecutor.HermesExecutorFactory.create(HermesExecutorFactory.java:27)
        at com.facebook.react.ReactInstanceManager$5.run(ReactInstanceManager.java:949)
        at java.lang.Thread.run(Thread.java:764)

Why libhermes.so needs to be loaded when RNBenchmark JSC is launching?🤔
Could u give me some help?
Thank u!

Environment

macOS 10.14.6
Python 3
Node 8.12.0

Please update benchmarks

Please update benchmarks between latest version of VMs
Thanks

kudo / react-native-js-benchmark Goto Github PK

react-native-js-benchmark's Introduction

JavaScript Engine Benchmark for React Native

Benchmark Results

Benchmarks

React Rendering

TTI (Time-To-Interaction)

APK Size

How to Run the Benchmark

Disclaimer

react-native-js-benchmark's People

Stargazers

Watchers

Forkers

react-native-js-benchmark's Issues

Description

Environment

Recommend Projects

Recommend Topics

Recommend Org