Giter Club home page Giter Club logo

Comments (3)

BrianSong avatar BrianSong commented on June 2, 2024 1

Hi @mayankanand007, currently MySQL backend use MEDIUMTEXT to store the string_value column in Property table. [1]

In MLMD v7, we modified string_value to use MEDIUMTEXT instead of TEXT to persist property value up to 16MB (16,777,215 bytes) - current limit. The 64 KB (65536 bytes) is for previous TEXT limit. See [2] for more details.

[1] https://github.com/google/ml-metadata/blob/master/ml_metadata/util/metadata_source_query_config.cc#L2163
[2] https://stackoverflow.com/questions/13932750/tinytext-text-mediumtext-and-longtext-maximum-storage-sizes

from ml-metadata.

mayankanand007 avatar mayankanand007 commented on June 2, 2024

it looks like there's internally some truncation going on within MLMD (see here) and the character limit for a string_value seems to be 65536, this makes me think that there's probably no way to define a LONGTEXT column. Can the team help me confirm that?​

from ml-metadata.

mayankanand007 avatar mayankanand007 commented on June 2, 2024

Thanks, @BrianSong! would you be able to link to me the right version I should be upgrading to? Currently, when I do pip show ml-metadata, I got the following response.

Name: ml-metadata
Version: 0.22.1
Summary: A library for maintaining metadata for artifacts.
Home-page: https://github.com/google/ml-metadata
Author: Google LLC
Author-email: [email protected]
License: Apache 2.0
Location: /data/user/mayank/miniconda3/envs/dev/lib/python3.7/site-packages
Requires: absl-py, protobuf, six, tensorflow
Required-by: mylib

EDIT: I think I found the right version: https://github.com/google/ml-metadata/releases/tag/v1.1.0, thanks a lot! for your help, I will close this issue.

from ml-metadata.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.