forked from powenyao/XR-Interaction-Toolkit-Examples
-
Notifications
You must be signed in to change notification settings - Fork 0
/
log_03_07_20.html
378 lines (351 loc) · 24.8 KB
/
log_03_07_20.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
<!DOCTYPE html>
<html lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<title>Weekly Log 3</title>
<meta name="description" content="Weekly Log 3">
<meta name="author" content="XROS">
<meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1.0, user-scalable=no">
<!--Import Google Icon Font-->
<link href="https://fonts.googleapis.com/icon?family=Material+Icons" rel="stylesheet">
<!--Import materialize.css-->
<link type="text/css" rel="stylesheet" href="css/materialize.min.css" media="screen,projection"/>
<!--Let browser know website is optimized for mobile-->
<meta name="viewport" content="width=device-width, initial-scale=1.0"/>
<!-- CSS -->
<link href="css/style.css" type="text/css" rel="stylesheet" media="screen,projection"/>
</head>
<body>
<main>
<!-- Navigation Bar -->
<nav class="nav-extended cyan darken-1" role="navigation">
<div class="nav-wrapper container">
<div class="row">
<div class="col s12 m6 l6"><h5 class="left-align">Weekly Log 3</h5></div>
<div class="col s12 m6 l6"><h5 class="right-align">03/01/2020 - 03/07/2020</h5></div>
</div>
</div>
<div class="nav-content container">
<ul class="tabs tabs-transparent">
<li class="tab"><a class="active" href="#Overview">Overview</a></li>
<li class="tab"><a href="#Done">Done</a></li>
<li class="tab"><a href="#TODO">TODO</a></li>
</ul>
</div>
</nav>
<div id="Overview">
<div class="container">
<div class="section">
<h4>Headline</h4>
<div class="divider"></div>
<ul class="browser-default">
<!-- ############# HEADLINES START HERE !!! ############# -->
<li>
<h5><b>[Subsystem 1]</b>
Published <a href="camera_calibration_instruction.html">an instruction for multi-view camera calibration.</a></h5>
</li>
<li>
<h5><b>[Subsystem 2]</b>
Published <a href="layer_instruction.html">an instruction for usage of layers in the project.</a></h5>
</li>
</ul>
</div>
</div>
</div>
<div id="Done">
<div class="container">
<div class="section">
<div class="row">
<div class="col s12 m12 l12">
<div class="card">
<div class="card-content">
<span class="card-title">Hanyuan Xiao, Hyuck Ju (Tommy) Kim</span>
<div class="divider"></div>
<br>
<div class="row valign-wrapper">
<div class="col s2 m2 l2">
<img src="misc/avatar_hanyuan_xiao.jfif" alt="" class="circle responsive-img" width="70%">
<img src="misc/avatar_tommy.jfif" alt="" class="circle responsive-img" width="70%">
</div>
<div class="col s10 m10 l10">
<ul class="browser-default">
<!-- ############# INDIVIDUAL ACCOMPLISHMENTS START HERE !!! ############# -->
<li>As we investigated and learned multiple camera calibration approaches, here we publish an <a href="camera_calibration_instruction.html">instruction</a> to the public.</li>
<li>Finished and tested script to convert 2D keypoint to 3D keypoint.</li>
<li>In order to feed data to Unity and transform the avatar's 3D joints, we used <a href="https://github.com/keel-210/OpenPose-Rig">openpose-rig</a> and edited the script</li>
<li>The result was very bad as shown in the gif.</li>
<li>Thus starting debugging, and realized that the 2D keypoints were fine, but the converted 3D keypoints were very off. </li>
<p><div class="container center"><img class="materialboxed" width="100%" src="./misc/log3/triangulation_test_360.gif"></div></p>
</ul>
</div>
</div>
</div>
</div>
</div>
<div class="col s12 m12 l12">
<div class="card">
<div class="card-content">
<span class="card-title">Hong Liu (Sherry)</span>
<div class="divider"></div>
<br>
<div class="row valign-wrapper">
<div class="col s2 m2 l2">
<img src="misc/avatar_hong_liu.jpg" alt="" class="circle responsive-img" width="70%">
</div>
<div class="col s10 m10 l10">
<ul class="browser-default">
<!-- ############# INDIVIDUAL ACCOMPLISHMENTS START HERE !!! ############# -->
<li>Adjust the size of the folder, enhance the user feelings.
</li>
<li>Make each layer of the folder semi-transparent so that you can see objects in the back layer.
</li>
<li>Add socket to the 3D folder, so that the containerobject can be attracted to the socket.
</li>
<li>Made a traditional folder to compare efficiency with the 3D folder.
</li>
<p><div class="container center"><img class="materialboxed" width="100%" src="./misc/log3/0309_3DFolders_sherry.gif"></div></p>
</ul>
</div>
</div>
</div>
</div>
</div>
<div class="col s12 m12 l12">
<div class="card">
<div class="card-content">
<span class="card-title">Jessi Jia</span>
<div class="divider"></div>
<br>
<div class="row valign-wrapper">
<div class="col s2 m2 l2">
<img src="misc/avatar_jessi_jia.jpg" alt="" class="circle responsive-img" width="70%">
</div>
<div class="col s10 m10 l10">
<ul class="browser-default">
<!-- ############# INDIVIDUAL ACCOMPLISHMENTS START HERE !!! ############# -->
<li>A traditional keyboard layout is implemented to compare input speed with 3d keyboards. A testing paragraph is added to both scenes so that if a user enters this paragraph with both layouts, we cam calculate the input speeds and compare.
</li>
<li>Challenges:
Unable to make traditional keyboard layout clickable because the there is no parent canvas to the button.
</li>
<p><div class="container center"><img class="materialboxed" width="100%" src="./misc/log3/separatekeyboard.gif"></div></p>
<p><div class="container center"><img class="materialboxed" width="100%" src="./misc/log3/keyboardclick.gif"></div></p>
</ul>
</div>
</div>
</div>
</div>
</div>
<div class="col s12 m12 l12">
<div class="card">
<div class="card-content">
<span class="card-title">Shinyee Lin</span>
<div class="divider"></div>
<br>
<div class="row valign-wrapper">
<div class="col s2 m2 l2">
<img src="misc/avatar_shinyee.jpg" alt="" class="circle responsive-img" width="70%">
</div>
<div class="col s10 m10 l10">
<ul class="browser-default">
<!-- ############# INDIVIDUAL ACCOMPLISHMENTS START HERE !!! ############# -->
<li>Add a screenshot taker working on Unity Editor and PC Build (Test on Mac).
</li>
<li>Challenges:
Unable to test it on Android and VR headset.
</li>
</ul>
</div>
</div>
</div>
</div>
</div>
<div class="col s12 m12 l12">
<div class="card">
<div class="card-content">
<span class="card-title">Feiyu(Robert) Miao</span>
<div class="divider"></div>
<br>
<div class="row valign-wrapper">
<div class="col s2 m2 l2">
<img src="misc/avatar_feiyu_miao.jpg" alt="" class="circle responsive-img" width="70%">
</div>
<div class="col s10 m10 l10">
<ul class="browser-default">
<!-- ############# INDIVIDUAL ACCOMPLISHMENTS START HERE !!! ############# -->
<li>Seperate components of controllers into different layers.</li>
<li>Fixed the bug that some objects which have Movement Type of Velocity Tracking collide with the ray emitters.</li>
<li>Fixed the bug that the object grabbed may change its forward direction and position when direction of ray is changed.</li>
<li>Fixed the problem that components of controller may interact with other objects unexpectly.</li>
<li>Fixed the problem that ray emitter may select its own controller body (sphere around the controller)</li>
<li>Fixed the problem that if user's controller's ray emitter collide with other physical object while changing its dierection, the emitter may turning unexpectly.</li>
<li>Implement the fucntion of ray length changes. User now could point to the sphere around the controllers and grab to change the length of the ray.</li>
<p><img src="misc/Log_Robert/Part2.gif" alt=""></p>
</ul>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div id="TODO">
<div class="container">
<div class="section">
<div class="row">
<div class="col s12 m12 l12">
<div class="card">
<div class="card-content">
<span class="card-title">Hanyuan Xiao, Hyuck Ju (Tommy) Kim</span>
<div class="divider"></div>
<br>
<div class="row valign-wrapper">
<div class="col s2 m2 l2">
<img src="misc/avatar_hanyuan_xiao.jfif" alt="" class="circle responsive-img" width="70%">
<img src="misc/avatar_tommy.jfif" alt="" class="circle responsive-img" width="70%">
</div>
<div class="col s10 m10 l10">
<ul class="browser-default">
<!-- ############# INDIVIDUAL TODO LIST STARTS HERE !!! ############# -->
<li>Debug through 2D-3D skeleton extraction pipeline.</li>
<li>Look into using Kinect v2 to make a real-time pose estimating unity avatar</li>
</ul>
</div>
</div>
</div>
</div>
</div>
<div class="col s12 m12 l12">
<div class="card">
<div class="card-content">
<span class="card-title">Hong Liu (Sherry)</span>
<div class="divider"></div>
<br>
<div class="row valign-wrapper">
<div class="col s2 m2 l2">
<img src="misc/avatar_hong_liu.jpg" alt="" class="circle responsive-img" width="70%">
</div>
<div class="col s10 m10 l10">
<ul class="browser-default">
<!-- ############# INDIVIDUAL TODO LIST STARTS HERE !!! ############# -->
<li>Continue adjust 3D folder.</li>
<li>Make a traditional 2D folder to compare with 3D folder.</li>
</ul>
</div>
</div>
</div>
</div>
</div>
<div class="col s12 m12 l12">
<div class="card">
<div class="card-content">
<span class="card-title">Jessi Jia</span>
<div class="divider"></div>
<br>
<div class="row valign-wrapper">
<div class="col s2 m2 l2">
<img src="misc/avatar_jessi_jia.jpg" alt="" class="circle responsive-img" width="70%">
</div>
<div class="col s10 m10 l10">
<ul class="browser-default">
<!-- ############# INDIVIDUAL TODO LIST STARTS HERE !!! ############# -->
<li>Add a backspace button to both layouts. Make testing paragraph lower so that users are able to see it easily.
</li>
</ul>
</div>
</div>
</div>
</div>
</div>
<div class="col s12 m12 l12">
<div class="card">
<div class="card-content">
<span class="card-title">Shinyee Lin</span>
<div class="divider"></div>
<br>
<div class="row valign-wrapper">
<div class="col s2 m2 l2">
<img src="misc/avatar_shinyee.jpg" alt="" class="circle responsive-img" width="70%">
</div>
<div class="col s10 m10 l10">
<ul class="browser-default">
<!-- ############# INDIVIDUAL TODO LIST STARTS HERE !!! ############# -->
<li>Add a panel with a scrollbar that shows multiple pictures like a simple photo gallery.
</li>
</ul>
</div>
</div>
</div>
</div>
</div>
<div class="col s12 m12 l12">
<div class="card">
<div class="card-content">
<span class="card-title">Robert(Feiyu) Miao</span>
<div class="divider"></div>
<br>
<div class="row valign-wrapper">
<div class="col s2 m2 l2">
<img src="misc/avatar_feiyu_miao.jpg" alt="" class="circle responsive-img" width="70%">
</div>
<div class="col s10 m10 l10">
<ul class="browser-default">
<!-- ############# INDIVIDUAL TODO LIST STARTS HERE !!! ############# -->
<li>Implement the function of movable ray emitters.</li>
<li>Find the appropriate logrithmic function to map the length of ray to the distance between two controllers when user are changing the length of ray.</li>
<li>Since Powen has given me the prior demonstration environment, I will try to implement it into the new project.</li>
<li>Fix possible bugs.</li>
</ul>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</main>
<footer class="page-footer cyan darken-1">
<div class="container">
<div class="row">
<div class="col l6 s12">
<h5 class="white-text">XROS Team</h5>
<div class="divider"></div>
<ul>
<li><a class ="white-text" href="https://www.linkedin.com/in/powenyao/">Powen Yao</a></li>
<li><a class ="white-text" href="https://github.com/SophieJiangHJ">Huijun Jiang</a></li>
<li><a class ="white-text" href="https://corneliushsiao.github.io/">Hanyuan Xiao</a></li>
<li><a class ="white-text" href="https://www.linkedin.com/in/hong-liu-0016751a6">Hong Liu</a></li>
<li><a class ="white-text" href="https://www.linkedin.com/in/ruoxi-jia/">Ruoxi Jia</a></li>
<li><a class ="white-text" href="https://www.linkedin.com/in/feiyu-miao-bba50b179/">Feiyu Miao</a></li>
<li><a class ="white-text" href="https://www.linkedin.com/in/hyuckjukim/">Hyuck Ju Kim</a></li>
<li><a class ="white-text" href="https://www.linkedin.com/in/csxinyilin/">Xinyi Lin</a></li>
</ul>
</div>
<div class="col l4 offset-l2 s12">
<h5 class="white-text">Home</h5>
<div class="divider"></div>
<ul>
<li><a class ="white-text" href="index.html">Overview</a></li>
<li><a class ="white-text" href="designdoc.html">Design Doc</a></li>
<li><a class ="white-text" href="api.html">API</a></li>
<li><a class ="white-text" href="blogs.html"><b>Blogs</b></a></li>
</ul>
</div>
</div>
</div>
<div class="footer-copyright">
<div class="container white-text">
Contents © 2020 XROS Team
</div>
</div>
</footer>
<!--JavaScript at end of body for optimized loading-->
<script type="text/javascript" src="https://code.jquery.com/jquery-2.1.1.min.js"></script>
<script type="text/javascript" src="js/materialize.min.js"></script>
<script type="text/javascript" src="js/init.js"></script>
</body>
</html>