v0.3.2

Highlights

• Add nerfacto-huge model
• Add text-to-3d model generfacto
• Support for CPU and M1/M2
• Support for rendering omni-directional stereo video
• Bug fixes

What's Changed

• Update installation docs by @tancik in #1970
• generalize mask collation to other image-like data by @decrispell in #1959
• fix large number of typos in repository by @MvWouden in #1977
• Basic viser frontend by @tancik in #1973
• Add warnings for (slower) Torch 1.x and Windows not supporting torch.compile by @jkulhanek in #1982
• Added at_train_end logic to base pipeline by @maturk in #1932
• Bump socket.io-parser from 4.2.1 to 4.2.3 in /nerfstudio/viewer/app by @dependabot in #1983
• fix visualize encoding bug by @SophusDavid in #1984
• Fix Viewer Recursion: StackOverflow in Server Setup by @lukasHoel in #1987
• Fix custom dataparser docs by @tancik in #1991
• style(ruff): provide better integration with ruff vscode extension by @SauravMaheshkar in #1994
• Fix viewer decorator by @tancik in #1995
• SIGGRAPH 2023 Citation Update by @ethanweber in #1997
• add deepfloyd model by @terrancewang in #1993
• pass grad scaler from trainer to pipeline by @terrancewang in #1996
• Fix exponential decay warmup by @tancik in #2002
• Ability to use vanilla pytorch instead of tcnn for Nerfacto by @ethanweber in #1936
• Fixes wandb runs resuming using WANDB_RUN_ID by @jkulhanek in #2004
• add controls to the beta viewer by @tancik in #2005
• Render Omni-directional stereo video (360 3D VR) by @cvachha in #1986
• Bump tyro by @brentyi in #2008
• Add Metadata Handling to Cameras Collation Function by @MingwuZheng in #2001
• [WIP] Fix model loading collate_fn non-static by @jkulhanek in #1990
• Colab update to Python 3.10 by @akristoffersen in #2017
• Update metashape_utils.py by @henrypearce4D in #2011
• Add antialias parameter as default None by @maturk in #2033
• installation.md: Use https instead of ssh for git clone. by @SharkWipf in #2030
• Add option for model normals on ply export by @CameronFraser in #1965
• Fix Typo on colab file by @Bishadkoju in #2039
• Fix bug when copying images when input_dir = output_dir by @maturk in #2041
• Reduce GPU memory usage in CacheDataloader by @jkulhanek in #1730
• Quick fix for eval script failing for depth-nerfacto (and other methods with a non-standard dataset) by @jMysliwiec in #2047
• Fix metashape multiple camera models error message by @henrypearce4D in #2057
• Add kwargs to dataparser outputs by @maturk in #2053
• nerfstudio dataparser: avoid loading images at inference time by @f-dy in #2051
• fix for scannet dataset camera pose loading by @colin-de in #2056
• colormaps: add "gray" by @f-dy in #2058
• Move out NeRFPlayer: clean files and add method link by @lsongx in #2072
• Update data_utils doc by @tancik in #2076
• nerfacto-huge by @kerrj in #2003
• reduce nerfacto-huge memory by @kerrj in #2082
• Fix data downscale paths by @tancik in #2071
• don't force downscale factor to 1 for nerfacto-huge by @machenmusik in #2088
• Fix resolution rendering logic in statemachine for viewer beta by @kerrj in #2085
• [WIP] dreamfusion implementation by @terrancewang in #1008
• add gradient accumulation support by @ksnzh in #2049
• Add non-trainable camera indices to CameraOptimizer by @maturk in #2080
• Update nerfacto.md by @Shiva-Gantha in #2107
• Add option to process masks on GPU for speed at the expense of memory by @machenmusik in #2110
• Fixing the image_dir if using skip_image_processing by @Khoa-NT in #2111
• Allow newer pycolmap for newer python by @jkulhanek in #2113
• Fix spherical harmonics #2081 by @jkulhanek in #2112
• Fix quickstart doc for remote host viewing setup by @jlightfoot in #2101
• v0.3.2 by @tancik in #2118

New Contributors

• @MingwuZheng made their first contribution in #2001
• @SharkWipf made their first contribution in #2030
• @CameronFraser made their first contribution in #1965
• @Bishadkoju made their first contribution in #2039
• @jMysliwiec made their first contribution in #2047
• @colin-de made their first contribution in #2056
• @Shiva-Gantha made their first contribution in #2107
• @Khoa-NT made their first contribution in #2111
• @jlightfoot made their first contribution in #2101

Full Changelog: v0.3.1...v0.3.2