Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About lora #74

Open
fenght96 opened this issue Dec 18, 2024 · 8 comments
Open

About lora #74

fenght96 opened this issue Dec 18, 2024 · 8 comments

Comments

@fenght96
Copy link

Any plan for lora?

@likemango
Copy link

As far as I know, it seems non sense for lora in 3D. Lora use for the 2D style. What is style about 3D?

@MangoLion
Copy link

lora is a concept, people apply lora to applicable model architectures. there's loras for llms and other stuff too

@likemango
Copy link

lora is a concept, people apply lora to applicable model architectures. there's loras for llms and other stuff too

Lora for customize output style. When it comes to 3D, how to define 3D style? As 3D style defined by 2D image.

@FishWoWater
Copy link

3D Models also have styles (e.g. lowpoly, stone style, pocket monster). The idea is to train a LoRA for the DiT model , as the practive of Section.5 of CLAY. Not sure whether TRELLIS will support this.
Image

@likemango
Copy link

3D Models also have styles (e.g. lowpoly, stone style, pocket monster). The idea is to train a LoRA for the DiT model , as the practive of Section.5 of CLAY. Not sure whether TRELLIS will support this. Image

Thanks for your sharing, that inspire me. But CLAY demo has been depreacted and its project move to Rodin(commercial project)

@FishWoWater
Copy link

FishWoWater commented Dec 27, 2024

@YuDeng Hi, do you have any plan of releasing/training a lora for TRELLIS?

If not, I would like to have a try. I want to start from some lowpoly style, or optimizing for 3D cartoon human models.

The motivation is that many 3DAIGC works have bad performance on human/character models (faces or bodys).

I can filter out and clean the charcacter models in Objaverse-XL(perhaps along with other datasets), and use them to train a small lora for the two DiT models in TRELLIS.

Do you have any advice on this (is it feasible?) Thanks :)

@YuDeng
Copy link
Contributor

YuDeng commented Dec 27, 2024

Hi @FishWoWater, we do not have any specific plan for the lora part.

If you want to train a lora model for character, I think it's better to collect more data beyond the Objaverse-XL. The character models in Objaverse-XL should already be included in our training set.

@FishWoWater
Copy link

OK, thanks

Hi @FishWoWater, we do not have any specific plan for the lora part.

If you want to train a lora model for character, I think it's better to collect more data beyond the Objaverse-XL. The character models in Objaverse-XL should already be included in our training set.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants