certifaiai / classifai Goto Github PK

1, label file do not need numbering, just need class name on each line

2. what happens when we have two or more image with same name. (because yolo name the label same name as their file)
currently is pedestrian (1).txt and pedestrian (2).txt
is it a good idea to have pedestrian.png.txt and pedestrian.jpg.txt instead?
else we would miss which is which

When click select file and close without select any file. click select folder again. Below error code will occur.

java.lang.IllegalStateException: Application launch must not be called more than once
at com.sun.javafx.application.LauncherImpl.launchApplication(LauncherImpl.java:162)
at com.sun.javafx.application.LauncherImpl.launchApplication(LauncherImpl.java:143)
at javafx.application.Application.launch(Application.java:252)
at ai.certifai.selector.FolderSelector.runMain(FolderSelector.java:40)
at ai.certifai.server.ServerVerticle$2.run(ServerVerticle.java:281)

When select an existing project, the words might be too difficult to understand

maybe change to Project Loading ?

need to stream backend logs to a file rather than console for better debugging

for example when customer / client have problem, ask them to give back us the log file

a.c.data.type.image.PdfHandler - PDF Skipped. Failed to read in pdf: C:\Users\PuienYeng.Yuen\Downloads\Angels\PI.20.06.011(1310562391).pdf
Exception in thread "AWT-EventQueue-0" java.lang.NullPointerException
at java.util.ArrayList.addAll(Unknown Source)
at ai.certifai.util.ImageHandler.checkFile(ImageHandler.java:236)
at ai.certifai.util.ImageHandler.processFile(ImageHandler.java:280)
at ai.certifai.selector.FileSelector$1.run(FileSelector.java:82)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)

ERROR TypeError: “s.WritableStream is not a constructor”
    createWriteStream http://localhost:8080/main-es2015.8a221541be6d33d18223.js:1
    Ut http://localhost:8080/main-es2015.8a221541be6d33d18223.js:1
    Dt http://localhost:8080/main-es2015.8a221541be6d33d18223.js:1
    invokeTask http://localhost:8080/polyfills-es2015.690002c25ea8557bb4b0.js:1
    onInvokeTask http://localhost:8080/main-es2015.8a221541be6d33d18223.js:1
    invokeTask http://localhost:8080/polyfills-es2015.690002c25ea8557bb4b0.js:1
    runTask http://localhost:8080/polyfills-es2015.690002c25ea8557bb4b0.js:1
    invokeTask http://localhost:8080/polyfills-es2015.690002c25ea8557bb4b0.js:1
    p http://localhost:8080/polyfills-es2015.690002c25ea8557bb4b0.js:1
    f http://localhost:8080/polyfills-es2015.690002c25ea8557bb4b0.js:1
 main-es2015.8a221541be6d33d18223.js:1:34769
Failed to get service worker registration(s): Storage access is restricted in this context due to user settings or private browsing mode. mitm.html:40:33
SecurityError: The operation is insecure. mitm.html:40

@bobbyskymind how are we supporting this?
alternatively if we are not solving this, we can put up that firefox is not supported for now.

Labelling box cannot be move on one image once drawn and assign labels (while another can)
Even delete and start over again has the same errror.

Here's the video to show it.
https://drive.google.com/file/d/1AgazWP4_vQon0ROP5Sgv_9CMJD6xHRpY/view?usp=sharing

Error occur during running .jar file on very first time. During development phase, there database already created and i did not delete it. Follow by, starting to run .jar. It stopped Classifai application unable to start.

Solution : delete the .data folder and rerun the .jar.

https://gist.github.com/chiaweilim/93e9e2354c359811a8569d521c7481c8

https://gist.github.com/chiaweilim/03804834fabd3697aa70c6209dd22c71

ai.certifai.MainVerticle - Classifai started successfully
ai.certifai.MainVerticle - Go on and open http://localhost:9999
a.c.d.portfolio.PortfolioVerticle - Create project with name: dualipa in portfolio table
2020-07-02T12:31:14.800+0800 WARNING Invalid ToUnicode CMap in font MUFUZY+Raleway-Regular
a.c.d.portfolio.PortfolioVerticle - Create project with name: dualipa1 in portfolio table
2020-07-02T12:34:50.293+0800 WARNING Invalid ToUnicode CMap in font MUFUZY+Raleway-Regular
a.c.d.portfolio.PortfolioVerticle - Create project with name: dualipa2 in portfolio table
2020-07-02T12:35:14.957+0800 WARNING Invalid ToUnicode CMap in font MUFUZY+Raleway-Regular
a.c.d.portfolio.PortfolioVerticle - Create project with name: dualipa3 in portfolio table
2020-07-02T12:36:53.000+0800 WARNING Invalid ToUnicode CMap in font MUFUZY+Raleway-Regular
a.c.d.portfolio.PortfolioVerticle - Create project with name: agr in portfolio table
2020-07-02T12:37:30.327+0800 WARNING Invalid ToUnicode CMap in font MUFUZY+Raleway-Regular
a.c.d.portfolio.PortfolioVerticle - Create project with name: dualipa5 in portfolio table
a.c.d.portfolio.PortfolioVerticle - Create project with name: plm in portfolio table
2020-07-02T12:41:33.763+0800 WARNING Invalid ToUnicode CMap in font MUFUZY+Raleway-Regular
a.c.d.portfolio.PortfolioVerticle - Create project with name: lipa1 in portfolio table
2020-07-02T12:42:46.249+0800 WARNING Invalid ToUnicode CMap in font MUFUZY+Raleway-Regular
a.c.d.portfolio.PortfolioVerticle - Create project with name: lipa2 in portfolio table
2020-07-02T12:43:04.746+0800 WARNING Invalid ToUnicode CMap in font MUFUZY+Raleway-Regular
a.c.d.portfolio.PortfolioVerticle - Create project with name: f9 in portfolio table
2020-07-02T12:44:18.929+0800 WARNING Invalid ToUnicode CMap in font MUFUZY+Raleway-Regular

OS: Windows
Browser: Firefox
Date of error found: july 2nd.

When press select file and file is chosen. either 1 from 2 scenario will happen :

1. the file selected is not the file that chosen but is one of the image is already in database.

2)server error and hang on frontend (the server processing is keep running).

below are the error message snippet from server side log.

2020-06-05T15:06:14.619+0800 SEVERE Unhandled exception
java.lang.UnsupportedOperationException
at java.util.AbstractList.add(Unknown Source)
at java.util.AbstractList.add(Unknown Source)
at java.util.AbstractCollection.addAll(Unknown Source)
at ai.certifai.database.portfolio.PortfolioVerticle.lambda$updateUUIDList$9(PortfolioVerticle.java:316)
at io.vertx.ext.jdbc.impl.JDBCClientImpl.lambda$null$1(JDBCClientImpl.java:175)
at io.vertx.core.impl.ContextImpl.executeTask(ContextImpl.java:369)
at io.vertx.core.impl.EventLoopContext.lambda$executeAsync$0(EventLoopContext.java:38)
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:500)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Unknown Source)

15:06:14.629 [vert.x-eventloop-thread-5] ERROR a.c.database.project.ProjectVerticle - integrity constraint violation: unique constraint or index vi
olation; SYS_PK_10091 table: PROJECT
2020-06-05T15:06:32.054+0800 SEVERE Unhandled exception
java.lang.UnsupportedOperationException
at java.util.AbstractList.add(Unknown Source)
at java.util.AbstractList.add(Unknown Source)
at java.util.AbstractCollection.addAll(Unknown Source)
at ai.certifai.database.portfolio.PortfolioVerticle.lambda$updateUUIDList$9(PortfolioVerticle.java:316)
at io.vertx.ext.jdbc.impl.JDBCClientImpl.lambda$null$1(JDBCClientImpl.java:175)
at io.vertx.core.impl.ContextImpl.executeTask(ContextImpl.java:369)
at io.vertx.core.impl.EventLoopContext.lambda$executeAsync$0(EventLoopContext.java:38)
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:500)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Unknown Source)

15:06:32.061 [vert.x-eventloop-thread-7] ERROR a.c.database.project.ProjectVerticle - integrity constraint violation: unique constraint or index vi
olation; SYS_PK_10091 table: PROJECT

Need to reproduce

Solved in cw_hla_debug branch commit #e05cb0a

When backend failed,
it will return 200/204 ok.
(This is to prevent front end failed)

yet the message key with 0 and 1 will hint whether the reaction really did happen .

if message == 0 (failed)
there will be errormessage as well, should we prompt a message box with the stated error messages so the end users have a a better idea

when label is saved, output is correct
1 0.4434369602763385 0.8976190476190476 0.38255613126079446 0.12222222222222222

when label is manually created, yolo output is wrong

hat 0.29318181818181815 0.2884097035040431 0.2318181818181818 0.5606469002695418 
hat 0.5075757575757576 0.20889487870619947 0.22424242424242424 0.4123989218328841 

Not visible. Ask me for more details.

1. Need changes to SelectorHandler
2. do not rewrite save if file ".png" exist
3. save all images of pdf
4. need endpoint to say select image
5. generator is poorly written

Note: pdf to png should not be of same folder, because it complicates the reloading when png is there

Can we change project id to project name?
Sounds more logical in the eye of public

Need to work on documentation

• how to build
• how to debug front end , what to do when update front end (clearcache)
• how to debug back end
• where is database /how to delete database

backend
https://gist.github.com/chiaweilim/d452455ab9b2f689ec8aaff0e05e4b6c
frontend @bobbyskymind

https://github.com/CertifaiAI/intellibel/blob/cw_dev_branch/document/featureRequest.md

After drawing certain amount of boxes, the intellij console will return error messages and boxes drawn after the error messages are not saved anymore.

I have checked the return status it shows 200 even though the return messages returns an error message

The boxes range are between 27-31 as I have ran 5 tests and i got error on :
First test: 27th box
Second test: 28th box
Third test: 31st box
Fourth test: 31st box
Fifth test: 28th box

The errror messages is shown at the screenshot below:

currently other than console output on server, there's nothing on frontend showing these

2020-07-07 12:32:55,796 138 [main] ERROR ai.certifai.config.PortSelector - IOException error during configure port,
java.net.BindException: Address already in use: JVM_Bind
at java.net.DualStackPlainSocketImpl.bind0(Native Method)
at java.net.DualStackPlainSocketImpl.socketBind(DualStackPlainSocketImpl.java:106)
at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)
at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:190)
at java.net.ServerSocket.bind(ServerSocket.java:375)
at java.net.ServerSocket.(ServerSocket.java:237)
at java.net.ServerSocket.(ServerSocket.java:128)
at ai.certifai.config.PortSelector.checkPortSanity(PortSelector.java:60)
at ai.certifai.config.PortSelector.checkPort(PortSelector.java:71)
at ai.certifai.config.PortSelector.configurePort(PortSelector.java:54)
at ai.certifai.ClassifaiApp.configure(ClassifaiApp.java:66)
at ai.certifai.ClassifaiApp.main(ClassifaiApp.java:35)

When Microsoft One Drive installed, desktop path could not be found resulted in installation failure

Workaround:
Unzip the window distribution, double click classifai.bat directly to run

classpath root not found.

Monitor of long display

Uploading files takes a long time, how to indicate the progress of uploading files?