Giter Club home page Giter Club logo

role-play-llms's Introduction

Role-Play-LLMs

Awesome License: MIT

Resource:

Model Resource Character Samples Language Source Method
PDP [paper], [--] 327 1,042,647 EN, ZH TV shows Experience Extraction, Dialogue Synthesis
Character-LLM [paper], [data] 9 1,900,800 EN Encyclopedia Experience Extraction, Dialogue Synthesis
ChatHaruhi [paper], [data] 32 54,726 EN, ZH Books, Games, Movies Experience Extraction, Dialogue Synthesis
RoleLLM [paper], [data] 100 140,726 EN, ZH Scripts Experience Extraction, Dialogue Synthesis
HPD [paper], [data] - 1,191* EN, ZH Books Dialogue Synthesis, Human Annotation
CharacterGLM [paper], [data] 250 1034* ZH Books, Scripts Experience Extraction, Dialogue Synthesis, Human Annotation
PIPPA [[paper],[data] 1,254 25,940* EN Character.ai-Users Dialogue Synthesis
RoleEval [paper], [data] 300 6,000 EN, ZH Encyclopedia Dialogue Synthesis
CharacterEval [paper], [data] 77 11,376 ZH Books, Scripts Experience Extraction, Human Annotation
CroSS-MR [paper], [data] 126 445 EN Literature-Analysis Experience Extraction
DITTO [paper], [data] 4,002 36,662 EN, ZH Encyclopedia Experience Extraction, Dialogue Synthesis
RoleInteract [paper], [data] 500 30,800 EN, ZH Books, Movies Experience Extraction, Dialogue Synthesis
LifeChoice [paper], [data] 1,401 1,401 EN Literature-Analysis Experience Extraction
InCharacter paper], [data] 32 18,304 EN, ZH Personality-Tests Dialogue Synthesis

Evaluation:

[1] INCHARACTER: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews. [paper], [code]

[2] Character-LLM: A Trainable Agent for Role-Playing. [paper], [code]

[3] RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models. [paper], [code]

(1) Raw groundtruths of general instructions without role-playing (RAW); (2) Customized general instruction responses with role-playing from RoleBench-general (CUS); (3) Role-specific instruction responses from RoleBench-specific (SPE).

[4] ChatHaruhi: Reviving Anime Character in Reality via Large Language Model. [paper], [code]

[5] CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation. [paper], [code]

[6] Toxicity Evaluation Toxicity in CHATGPT: Analyzing Persona-assigned Language Models. [paper]

[7] NarrativePlay: Interactive Narrative Understanding. [paper]

Acknowledgement

Please cite the following papers as the references if you use our codes or the processed datasets.

@article{xxxxx,
  title={xxxxxx},
  author={xxx},
  journal={arXiv preprint arXiv:xxx},
  year={2024}
}

role-play-llms's People

Contributors

starrylay avatar

Stargazers

 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.