sagioto / lipreading Goto Github PK
View Code? Open in Web Editor NEWLipReading - it will read your lips!
LipReading - it will read your lips!
Hi,
I have got empty (blank message) out put like :Initializing classifier
Model used: D:\video\test7.model
Weka ClassifierD:\video\test7.model
Classifier Initialized successfully from modeledu.lipreading.classification.SVMClassifier@23d66209
VideoCapture Class classify methd
LipReaderPanel Class handleRecordedSample Mthd
UTILS textToSpeech
Error when initializing classifier
java.io.FileNotFoundException: D:\Dropbox\LipReading\XMLs\models\yesNoHello\yesNoHelloDagan.model (The system cannot find the path specified)
how can i have yesNoHelloDagan.model?
Exception in thread "Thread-6" java.lang.RuntimeException: com.googlecode.javacv
.FrameGrabber$Exception: videoInput.getPixels() Error: Could not get pixels.
at edu.lipreading.gui.VideoCapturePanel$1.run(VideoCapturePanel.java:94)
at java.lang.Thread.run(Unknown Source)
Caused by: com.googlecode.javacv.FrameGrabber$Exception: videoInput.getPixels()
Error: Could not get pixels.
at com.googlecode.javacv.VideoInputFrameGrabber.grab(VideoInputFrameGrab
ber.java:168)
at edu.lipreading.gui.LipReaderPanel.getVideoFromSource(LipReaderPanel.j
ava:137)
at edu.lipreading.gui.VideoCapturePanel$1.run(VideoCapturePanel.java:92)
... 1 more
sometimes i have this error, but some times not. when i restart or hibernate my windows, the first time that i run the program, it works but after that i get this error. what is the reason?
When I run MainFrame.java ., the output frame opens up. But i cannot create a training set. The following error comes when saving the recorded sample :
Exception in thread "Thread-6" java.lang.UnsatisfiedLinkError: C:\Users\Harish ram\AppData\Local\Temp\javacpp22379175999116\jniavutil.dll: %1 is not a valid Win32 application
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary1(Unknown Source)
at java.lang.ClassLoader.loadLibrary0(Unknown Source)
at java.lang.ClassLoader.loadLibrary(Unknown Source)
at java.lang.Runtime.load0(Unknown Source)
at java.lang.System.load(Unknown Source)
at com.googlecode.javacpp.Loader.loadLibrary(Loader.java:418)
at com.googlecode.javacpp.Loader.load(Loader.java:368)
at com.googlecode.javacpp.Loader.load(Loader.java:315)
at com.googlecode.javacv.cpp.avutil.(avutil.java:75)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Unknown Source)
at com.googlecode.javacpp.Loader.load(Loader.java:334)
at com.googlecode.javacv.cpp.avcodec.(avcodec.java:85)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Unknown Source)
at com.googlecode.javacpp.Loader.load(Loader.java:334)
at com.googlecode.javacv.cpp.avformat.(avformat.java:76)
at com.googlecode.javacv.FFmpegFrameRecorder.(FFmpegFrameRecorder.java:111)
at com.googlecode.javacv.FFmpegFrameRecorder.(FFmpegFrameRecorder.java:104)
at com.googlecode.javacv.FFmpegFrameRecorder.(FFmpegFrameRecorder.java:107)
at com.googlecode.javacv.FFmpegFrameRecorder.(FFmpegFrameRecorder.java:101)
at main.java.edu.lipreading.gui.LipReaderPanel.getVideoFromSource(LipReaderPanel.java:150)
at main.java.edu.lipreading.gui.VideoCapturePanel$1.run(VideoCapturePanel.java:89)
at java.lang.Thread.run(Unknown Source)
Can anyone help me
when try to run GetFileTest.java in test case readFromUrlTest() i got this exception:
java.lang.UnsatisfiedLinkError: no jniavcodec in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1860)
at java.lang.Runtime.loadLibrary0(Runtime.java:845)
at java.lang.System.loadLibrary(System.java:1084)
at com.googlecode.javacpp.Loader.loadLibrary(Loader.java:711)
at com.googlecode.javacpp.Loader.load(Loader.java:586)
at com.googlecode.javacpp.Loader.load(Loader.java:540)
at com.googlecode.javacv.cpp.avcodec.(avcodec.java:39)
at com.googlecode.javacv.FFmpegFrameGrabber.(FFmpegFrameGrabber.java:103)
at edu.lipreading.vision.AbstractFeatureExtractor.getGrabber(AbstractFeatureExtractor.java:48)
at edu.lipreading.vision.AbstractFeatureExtractor.extract(AbstractFeatureExtractor.java:34)
at edu.lipreading.vision.GetFileTest.readFromUrlTest(GetFileTest.java:59)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197)
Caused by: java.lang.UnsatisfiedLinkError: C:\Users\mgr\AppData\Local\Temp\javacpp84231122631068\jniavcodec.dll: The specified procedure could not be found
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1928)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1825)
at java.lang.Runtime.load0(Runtime.java:792)
at java.lang.System.load(System.java:1059)
at com.googlecode.javacpp.Loader.loadLibrary(Loader.java:700)
... 32 more
hi
how can i run android version of lipreading? do i need to run server codes before runnig it?
i cant find lipreading.properties file. can anyone help me finding it ?
The line 117 of WebFeatureExtractor "public static void main(String[] args) throws Exception" reports the error "Exception Exception is not compatible with throws clause in Server.main(String[])" .
Some one help me pls ?
Hi,
I have download you are application ,when i have run live feed , i got File Not Found Exception , so could you please send me Model file , which you have already created ? or else let me know how to done Model File ?
Thanks and Regards
sameer
[email protected]
when i installed opencv2.4.2 , the lip keypoints are detected by color stickers, but cannot create training set.
when i installed opencv2.4.3 , the lip keypoints are NOT detected by color stickers, but i can create training set.
What is wrong ??
Exception in thread "main" java.lang.ExceptionInInitializerError
at main.java.edu.lipreading.vision.NoMoreStickersFeatureExtractor.init(NoMoreStickersFeatureExtractor.java:216)
at main.java.edu.lipreading.vision.NoMoreStickersFeatureExtractor.getPoints(NoMoreStickersFeatureExtractor.java:70)
at main.java.edu.lipreading.vision.AbstractFeatureExtractor.getPoints(AbstractFeatureExtractor.java:82)
at main.java.edu.lipreading.vision.AbstractFeatureExtractor.extract(AbstractFeatureExtractor.java:37)
at main.java.edu.lipreading.vision.NoMoreStickersFeatureExtractor.main(NoMoreStickersFeatureExtractor.java:390)
Caused by: java.lang.NullPointerException
at java.util.Properties$LineReader.readLine(Unknown Source)
at java.util.Properties.load0(Unknown Source)
at java.util.Properties.load(Unknown Source)
at main.java.edu.lipreading.Constants.(Constants.java:16)
... 5 more
***** VIDEOINPUT LIBRARY - 0.1995 - TFW07 *****
SETUP: Setting up device 0
SETUP: 1.3M HD WebCam
SETUP: Couldn't find preview pin using SmartTee
SETUP: Capture callback set
SETUP: Device is setup and ready to capture.
Can someone help me ??
when i run Mainframe.java, i get the following error :
java.lang.ClassNotFoundException: com.thoughtworks.xstream.XStream
at java.net.URLClassLoader$1.run(Unknown Source)
at java.net.URLClassLoader$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Unknown Source)
at weka.core.xml.XStream.read(XStream.java:253)
at main.java.edu.lipreading.Utils.getTrainingSetFromZip(Utils.java:152)
at main.java.edu.lipreading.TrainingSet.get(TrainingSet.java:29)
at main.java.edu.lipreading.gui.TrainingPanel.(TrainingPanel.java:89)
at main.java.edu.lipreading.gui.MainFrame.(MainFrame.java:109)
at main.java.edu.lipreading.gui.MainFrame$1.run(MainFrame.java:41)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$200(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$1.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
java.lang.NullPointerException
at main.java.edu.lipreading.gui.TrainingPanel.(TrainingPanel.java:89)
at main.java.edu.lipreading.gui.MainFrame.(MainFrame.java:109)
at main.java.edu.lipreading.gui.MainFrame$1.run(MainFrame.java:41)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$200(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$1.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
Exception while removing reference: java.lang.InterruptedException
java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(Unknown Source)
at java.lang.ref.ReferenceQueue.remove(Unknown Source)
at sun.java2d.Disposer.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
The error is in the line :
Sample read = (Sample) XStream.read(samplesZip.getInputStream(entries.nextElement()));
I have included weka3.7.3 jar. But i don't know how to correct it.
Please guide me
When I import the project to eclipse, the error appeared on the overview of pom.xml
Exception in thread "main" java.lang.ExceptionInInitializerError
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Unknown Source)
at com.googlecode.javacpp.Loader.load(Loader.java:553)
at com.googlecode.javacpp.Loader.load(Loader.java:532)
at com.googlecode.javacv.cpp.opencv_core$CvRect.(opencv_core.java:2005)
at main.java.edu.lipreading.vision.NoMoreStickersFeatureExtractor.(NoMoreStickersFeatureExtractor.java:53)
at main.java.edu.lipreading.vision.NoMoreStickersFeatureExtractor.main(NoMoreStickersFeatureExtractor.java:387)
Caused by: java.lang.IllegalStateException: Can't overwrite cause
at java.lang.Throwable.initCause(Throwable.java:456)
at com.googlecode.javacpp.Loader.load(Loader.java:581)
at com.googlecode.javacpp.Loader.load(Loader.java:532)
at com.googlecode.javacv.cpp.opencv_core.(opencv_core.java:134)
... 7 more
How to resolve this ?
Need to add Linux support
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.