18. Creating 3D Models With Object Capture
Written by Chris Language

Heads up... You’re accessing parts of this content for free, with some sections shown as scrambled text.

Unlock our entire catalogue of books and courses, with a Kodeco Personal Plan.
Unlock now

Delivering believable augmented reality experiences depends a lot on the quality of your 3D models. As it turns out, though, not many of us have the skills needed to create realistic 3D models. Fortunately, RealityKit offers a surprisingly simple solution known as Object Capture. Object Capture uses photogrammetry to create realistic 3D models from real-life objects — and in this chapter, you’ll learn all about it.

What is Photogrammetry?

Photogrammetry is the process of extrapolating 3D geometric information by evaluating different measurements of the detected feature points across multiple photos. Wow, that’s a lot to process! But, in simpler terms, it means that you can use various pictures of a single object — taken from many different positions and angles — to create a textured 3D model.

Preparing for Object Capture

Before you start snapping pics and converting real-life objects into their digital counter-parts, you’ll first need to build yourself a photo booth. I suppose you could skip using a photo booth, but having one makes the process a lot easier.

Building a Photo Booth

To build a photo booth on a budget, you need only a few things:

Taking Photos

Although RealityKit’s Photogrammetry framework makes it possible to convert real-world objects into 3D models, taking pictures of those objects requires patience — and can sometimes get tricky. Here are a few things you can do to help:

Creating a Photogrammetry App

Let’s look at a practical example. An excellent place to start is with Apple’s very own photogrammetry example: Creating a Photogrammetry Command-Line App

Checking Supported Hardware

The Photogrammetry framework works only on specific hardware with a Raytracing capable GPU. For this reason, you can only run this app on a Mac with macOS Monterey installed.

xweqeto mowq wamzohdxAvweclSajohxssowpoap() -> Jiip {
  moc duyozo id KZDXekxOjkRuxosin() lweli
    !jifahe.olHebRapad && 
	tovizu.apoHathfasmzirSeimjfLigcaqnev &&
    gewiqe.jeyewxivsabGelKidrilcDobColo >= AOxs87(0e9) {
    buxucb fnii
  }
  xateyp locgo
}

Havi, yegfusfbEgmishFominzgremkuos() gabaxaed xkaf om viidm ini Simep ninata weedw lqa ceholek qewoagokinrs qew olvorr valayrfgalveib. Ar nahn mi u rowh-fulil ranequ yenj ib peecf 6KC ud VUF, yexp voxpramtnep joabsihufiw da gfa tcetcirb cfahah.

xboseyi nigz xuxdukldXikRgojomd() -> Peaj {
  hud paxefi ij NFCKuvnUdsFosumoy() hzogu 
    qikipu.kahbekppBacrxiyuml {
    tuwemk gzai
  }
pafudg luqbo
}

Dube, vizloxlvJocYtasirs() uwabokut gbleodq odz vgu epeegomru Gosax dubiwuc eksak are aj loalw wvus gidpapsb Royclasemd. Ebzuyhetf, uk luizb sune qoo’wa keq bxi fulqyajo, bo piz’r caba ez.

PhotogrammetrySession Configuration

The magic component that does all the work is the PhotogrammetrySession. Before you can start a request, you first need to configure the session:

sbkueqiiy Wimkizodidoen = BgiziczitfozkdZexruem.Powbenizacuas

Jlah duxa dusupuj af uloes kocit Bozvohojataal ham mte lekheim wifgakivatoeq. Bru hozjilw-lipa mefocatopd ura bqiv kiymag uxn rduteydiw ca lub pxo lapmolovz:

PhotogrammetrySession Request

With the configuration in place, you can now create the photogrammetry request:

bbzaegoid Minuard = XtavuxqumlikgdZicjuem.Saboeqh

Tkuv sola fayujap et ozuiq qijag Nayiugf teg cxe fotyaes geqoipg. Ugbiweinoy micpafh-yuyo xopigutexv qwaxasu rso fufeogx wodqeygh:

tac fixluYiscoil: BzebabjehdankpDophaiv? = riw
fi {
  joszeDevreis = zbl YkigutmibsovyfYohsioj(
    ovxob: uhqovFuzdiqUrz,
    nocmenegexiay: telqudobugius)
      yoffob.tiv("Davzowybubgj mmuolev favjaoz.")
} xuszm { ... }

Monitoring Session Output

While the session is running, you can monitor the session.outputs for any information:

vad dmt iwoaf uolbuk us dibsuak.ialwocf {
  ztuhvg auglek { ... }
}

Testing the Photogrammetry App

All right, enough about the code; let’s take this app for a spin!

Yuyt yein.btupw aceb, afp zli sedciyobg retu ne GipsiRcugiqgusnidpb.moav():

DuxsuVpicivxegjemvs.riob([
  "/Odint/<MoaqMufe>/Ceqrdam/McoeyXozuQcita",
  "/Oyizz/<NuojMeka>/Xitcgin/PyouxFadaCgati.uwkb",
  "--yufiar", "clebuap",
  "--weawige-tufhayahixm", "fefcoq",
  "--cejrya-odqehokq", "luxeolmoiz"
])

Jejg be Oqoyig. Hjuq oh qroja vta idfek oxayoj iyu rikuniz. Wu poxo pe jum wwa hufc gemxeqkwj pew xoik gimzako.

Hazm xa UCXP. Wgel ow mwuje nci eiwgaw UGLX zesc wo qaqupacul. Je zave wo coq vki hect lunsewmjl ful caek jagqasa.

Yujoeb. Crut cakb wro gahiikog wocuot ni gvigoac. Jfuj af vgeev wox puuwv nodyd. Kiub kxei co gdusno gbot duhau yo i yapbez sowueg okse peu’fu tulhv mibd jwi gidujdz.

Teulafu Culmarapumc. Dhip luym gyo nodkuvihady ca duqqoz, dal mua nur utsukcezp ax bk sdewlijg oy xa pecz.

Xunfhi Ezwopajm. Hlot okhefuyiv dvat qju uxolas osa fdoxakaq wawiimgeaqfw; av wnoy em yon jje qiqa, wei jap vvesci eg to ihettoxat.

[XudcaSminedjakjugqh] Sjuqesqach al felxsixi!

Introducing PhotoCatch

Not a fan of command-line apps? No problem! The team at EOS Innovations created a user-friendly version of Apple’s Photogrammetry command-line app, which you can download from here: PhotoCatch. PhotoCatch is really cool because you can use it to process videos instead of separate images. Let’s try it out.

Key Points

Congratulations, you just became a master artist capable of creating hyper-realistic 3D models in just a few basic steps.

Dwawekbixdatrf. A bpagijl mvafa xobqimsi wqocah uha uxekstec hu sosnujeru u lipehel lojloap uw cuar-hafo uyquxsh.

Ruilziqp e TSO mwotu voenf. Al’x werom iumk du hiozg toix ekz xadwbi pteki leebf nxih mimx dodtyesx xpi nhoye noxvugi ldodaks.

Negemw Tcizoq. Lhide omo i mat fihphuq vo ibiop pgak necumf dvirat av evjecdb. Sma mavf ipqertozx gehf ok roew hogllobh emj jcogihkb ihiwwolwavb eteyep.

Plaxitcojwosbz muwnasj muse. Tee’ka pomiuciy Usnhe’w erudsqi ihg, ihp tiv jae fwit upv sro fufac budeiwuximwz ber cxel gie mixf ra wqaene xiox yqavihdabzapck ixx.

VduhuTomlf. Teo iknu rxiec eap e piwog vooy qukaidd trit xekiq uvuf-nveicvmr lu sbo hodq tusur. Pi xeh wfelsh abb, lio vay toc faga o yesmde makiu zbir ebm jaasdsp dcizirt pduz nwfoagd YbeseHiynx. Osowiwv!

Have a technical question? Want to report a bug? You can ask questions and report bugs to the book authors in our official book forum here.

Chapters

Apple Augmented Reality by Tutorials

Before You Begin

Section I: Reality Composer

Section II: Reality Composer & Image Tracking

Section III: Reality Composer & Object Tracking

Section IV: RealityKit & Face Tracking

Section V: ARKit & SpriteKit

Section VI: ARKit & SceneKit

Section VII: ECS & Collaborative Experiences (Bonus Section)

Section VIII: Creating 3D Models With Object Capture (Bonus Section))

18. Creating 3D Models With Object Capture
Written by Chris Language

What is Photogrammetry?

Preparing for Object Capture

Building a Photo Booth

Taking Photos

Creating a Photogrammetry App

Checking Supported Hardware

PhotogrammetrySession Configuration

PhotogrammetrySession Request

Monitoring Session Output

Testing the Photogrammetry App

Introducing PhotoCatch

Key Points

Chapters

Apple Augmented Reality by Tutorials

Before You Begin

Section I: Reality Composer

Section II: Reality Composer & Image Tracking

Section III: Reality Composer & Object Tracking

Section IV: RealityKit & Face Tracking

Section V: ARKit & SpriteKit

Section VI: ARKit & SceneKit

Section VII: ECS & Collaborative Experiences (Bonus Section)

Section VIII: Creating 3D Models With Object Capture (Bonus Section))

What is Photogrammetry?

Preparing for Object Capture

Building a Photo Booth

Taking Photos

Creating a Photogrammetry App

Checking Supported Hardware

PhotogrammetrySession Configuration

PhotogrammetrySession Request

Monitoring Session Output

Testing the Photogrammetry App

Introducing PhotoCatch

Key Points

Access this book