Giter Club home page Giter Club logo

Comments (10)

imxieyi avatar imxieyi commented on May 18, 2024 2

Turned out that setting computeUnits in MLModelConfiguration to cpuAndGPU can bypass neural engine for now.

The MPSNN implementation is partially finished. It will be released if it can be faster or results in better quality than Core ML in benchmarks.

In the future if I could get hands on a device with A12 chip, I still wish to try fixing for neural engine since it should be much faster even than GPU mode.

from waifu2x-ios.

sfslowfoodie avatar sfslowfoodie commented on May 18, 2024

I can confirm the image quality issue on my XS 256GB. Artifacts are visible on color gradients, the final images are unusable.
Running in CPU only mode quality is good as expected, however the XS takes about twice as much time to complete a task when compared to a 7 Plus.
I am available for trying out new builds.

from waifu2x-ios.

sfslowfoodie avatar sfslowfoodie commented on May 18, 2024

With regard to the waifu2x app in the App Store (which is what I am testing), is/will this app rely on both cpu And GPU to run the Core ML model, then?

from waifu2x-ios.

imxieyi avatar imxieyi commented on May 18, 2024

With regard to the waifu2x app in the App Store (which is what I am testing), is/will this app rely on both cpu And GPU to run the Core ML model, then?

Currently it only has Core ML as back end, which relys on GPU. If GPU is not supported it will fallback to CPU.

from waifu2x-ios.

sfslowfoodie avatar sfslowfoodie commented on May 18, 2024

What bugs me (what I don’t understand since I am not an expert on this matter) is why the performance on iPhone 7 Plus (A10 SOC, no neural engine) is still ~2X faster than on XS, excluding neural engine factors.
Running both iPhone models in Cpu Only mode, I see the A12 benefits (~35% faster cpu than the A10 cpu).
Disabling the Cpu Only however, the latest XS app still generates artifacts, implying it is still trying to use the neural engine, instead of relying on the GPU (as the A10 does).

from waifu2x-ios.

imxieyi avatar imxieyi commented on May 18, 2024

Weird... The model.configuration.computeUnits should have been set to .cpuAndGPU. It seems that this fix is ineffective. I will try to get hands on a device with A12 chip. Also a MPSNN update will be considered before then.

from waifu2x-ios.

ZhongDev avatar ZhongDev commented on May 18, 2024

Can confirm, also an issue on A13

from waifu2x-ios.

imxieyi avatar imxieyi commented on May 18, 2024

Can confirm, also an issue on A13

Can you provide a demo image and configurations? I cannot reproduce this issue on iPhone 11 Pro even with neural engine enabled.

from waifu2x-ios.

ZhongDev avatar ZhongDev commented on May 18, 2024

Sorry, I meant with coreML implementation.
There is still some banding; not as much as a12, but not as smooth as MPSCNN.

Overall it’s fine but I’ll see if I can get an example once I get home from school

from waifu2x-ios.

sfslowfoodie avatar sfslowfoodie commented on May 18, 2024

from waifu2x-ios.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.