PDF Compressor Pro
公立はこだて未来大学 2015 年度 システム情報科学実習
グループ報告書
Future University Hakodate 2015 System Information Science Practice
Group Report
プロジェクト名
Project Name
Musical and Visual Expression of Best Synchronization
グループ名
A
Group Name
A Group
プロジェクト番号/Project No.
20
プロジェクトリーダ/Project Leader
1013073
Nozomi Katsuhara
グループリーダ/Group Leader
1013073
Nozomi Katsuhara
グループメンバ/Group Member
1013013
Ryoma Tanabe
1013026
Shigeki Ozawa
1013032
Junki Tateishi
1013073
Nozomi Katsuhara
1013087
Tomoyuki Ito
1013123
Hiroshi Matsumoto
1013153
Takeru Saito
1013217
Sena Sakata
1013243
Azusa Dote
指導教員
Advisor
Takayuki Nakata Mitsuhiko Hanada
提出日
2016
1
20
Date of Submission
Janualy 20, 2016
PDF Compressor Pro
概要
PBL(Project Based Learning)
PBL
(
)
Antonio Camuuri
(2010)
Max
3
Processing
Open Sound Control(OSC)
Kinect
Kinect
Kinect
Processing
キーワード
,
,
:
-i-
PDF Compressor Pro
Abstract
PBL(Project Based Learning) is educational policy for ”nurturing of learning oneself”
and education style for students’s own problem-solving by projects form. In PBL, students can learn actively in solving specific problem. In its process, students can acquire
practical skills (problem-solving, reasoning, presentation etc.) which they can’t learn
in usual classroom lectures. It is multiply developed as the skill of which we can make
good use in actual places of work such as health care setting and engineering. Purpose
of our project is solving set problems using examples from previous study of Synchronization in the method of learning. Synchronization is what cycle of action and the
timing correspond. it appear in nature and daily life, We can assort it by presence or
absence of human conscious. In no conscious case, the length of stride fit naturally into
friend if we walk beside them. In the reverse case, everyone tune in to the object like
conductor of an orchestra. Antonio Camuuri etc. in University of Genoa have developed
the system which the number of musical component changes by the level of synchronization headcount. We developed the system which can make various expressions of
music light box and animation by synchronized headcount based on this previous study
of synchronization. We learn skills for developing the system communally in the process of problem-solving. In first term act, we aquired fundamental skill of Max that is
trained in music and multimedia to develop a system of synchronization determination.
we divided member into group and scout each groups for various ideas of synchronization. We made a presentation ideas for each groups. Then, we discussed and made it
a goal to made a system that form music by synchronization determination. In system of previous term, we made three groups for a division of labor as visual group,
Synchronization determination group and music group. Visual group made a program
that chase three person’s right hand and judge handwaving from information of camera by Processing. Synchronization determination group made a program that receives
information of three person’s right hand from visual group and judge how many people
synchronize. We divided synchronization determination into ”not synchronization” and
”synchronization of two person” and ”synchronization of three person”. Music group
made a system that form music by the level of synchronization. This music change from
bass note to melody by the level of synchronization. Bass note come when the level
of synchronization is low, melody come when the level of synchronization is high. We
connected these systems through Open Sound Control (OSC) to each other. Then, this
system was the deliverable in previous term. We have found that we can’t feel synchronization with the deliverable in previous from gap of synchronization determination
and not rhythmical music. In later term act, we acted for improving this system in
new consist of group by expressions the illumination and visual. Visual group divided
into Kinect group and Design group. Kinect group developed a system that keeps pace
with changes of fast-paced action with Kinect. Design group made a program that
can express the level of synchronization with animation of Processing. Synchronization
determination group made a program that changes BPM and improved the system of
previous term. Music group made some music that we can easily feel synchronization.
The illumination group made music light box that light changes by synchronization.
Then, We had demonstration of the system connected over OSC.
Keyword
Nurturing of learning oneself, problem-solving, Synchronization
:
- ii -
PDF Compressor Pro
目次
第1章
背景
1
1.1
第2章
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
到達目標
1
2
2.1
. . . . . . . . . . . . . . . . . . . . . . . . . . . .
2
2.1.1
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2
2.1.2
. . . . . . . . . . . . .
2
2.2
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2
2.3
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
4
第3章
課題解決のプロセスの概要
5
第4章
課題解決のプロセスの詳細
13
4.1
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
13
4.1.1
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
13
4.1.2
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
16
4.1.3
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
18
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
20
4.2
4.2.1
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
20
4.2.2
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
26
4.2.3
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
29
4.2.4
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
36
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
41
4.3.1
. . . . . . . . . . . . . . . . . . . . . . . . . . .
41
4.3.2
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
41
4.3.3
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
42
4.3.4
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
44
4.3
第5章
結果
5.1
第6章
6.1
45
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
45
5.1.1
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
45
5.1.2
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
45
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
47
5.2.1
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
47
5.2.2
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
47
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
48
5.2
5.3
Kinect
今後の課題と展望
51
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
- iii -
51
PDF Compressor Pro
6.2
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
51
6.3
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
52
6.3.1
. . . . . . . . . . . . . . . . . . . .
53
6.3.2
. . . . . . . . . . . . . . . . . . . . . . . . . .
53
6.3.3
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
53
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
54
6.4.1
. . . . . . . . . . . . . . . . . . . . . . . . . . . . .
54
6.4.2
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
54
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
55
6.5.1
. . . . . . . . . . . . . . . . . . . . . . . . . . . . .
55
6.5.2
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
56
6.4
6.5
付録 A
新規習得技術
57
付録 B
活用した講義
58
参考文献
59
- iv -
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
第1章
1.1
背景
本プロジェクトの背景
2
2
Cirelli,Einarson,Trainor(2014)
Varni, Mancini, Volpe, Camurri(2010)
(2015)
:
Group Report of 2015 SISP
-1-
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
第 2 章 到達目標
2.1
本プロジェクトにおける目的
:
2.1.1
具体的な目標設定
•
•
•
•
:
2.1.2
通常の授業ではなく、プロジェクト学習で行う利点
:
2.2
具体的な手順・課題設定
1. Max (Cycling ’74, San Francisco) [1]
Max
Group Report of 2015 SISP
-2-
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
Max
2.
•
Processing (Casey Reas, Benjamin Fry) [2]
Max
•
Max
Processing
Processing
•
Max
3.
4.
4
Kinect
5
• Kinect
Kinect (Microsoft, USA) [3]
Kinect
C
C
Max
•
•
•
•
:
Group Report of 2015 SISP
-3-
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
2.3
課題の割り当て
•
–
Processing
–
Max
Max
Max
–
•
– Kinect
Kinect
Kinect
–
–
–
–
:
Group Report of 2015 SISP
-4-
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
第3章
課題解決のプロセスの概要
1.
•
3
Processing
(
3.1)
3
•
1
Group Report of 2015 SISP
-5-
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
2
Kinect
Kinect
Kinect
(
3.2
Kinect
Kinect
Kinect
2.
•
3
Max
Group Report of 2015 SISP
3.3
-6-
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
1
1
1
2
2
2
•
(
3.4)
1
3
0,1,2,3,4
8
3
3.
•
Group Report of 2015 SISP
-7-
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
Domino
(
3.5)
MIDI
Domino
3
8
•
Group Report of 2015 SISP
-8-
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
3
4.
•
RainbowCube
(
3.6)
RainbowCube
4x4x4
Processing
0,1,2,3,4
RainbowCube
RainbowCube
•
3
Processing
(
4.21)
3
:
Group Report of 2015 SISP
-9-
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
3.1
3.2 Kinect
3.3 Max
Group Report of 2015 SISP
- 10 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
3.4 Max
3.5 Domino
3.6 RainbowCube
Group Report of 2015 SISP
- 11 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
3.7 dancer
Group Report of 2015 SISP
- 12 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
第4章
4.1
課題解決のプロセスの詳細
前期
3m
:
4.1.1
映像班
映像班の概要
•
•
Processing
Group Report of 2015 SISP
- 13 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
MAX
MAX
MAX
midi
MAX
Processing
:
右手の動きの検出
•
PC
Group Report of 2015 SISP
- 14 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
•
RGB Red, Green, Blue
30
4.1
4.1
:
判定方法
Group Report of 2015 SISP
- 15 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
1
x
x
,y
,y
x
,y
3
:
4.1.2
同期班
同期班の概要
3
Max 7
OSC
5
6
3
A’,B’,C’
A
B
A,B,C
A’ B
C
B’ C
A
C’
7
Max
javascript
:
Group Report of 2015 SISP
- 16 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
Max7 について
Max7
Cycling’74
(
)
Max
javascript
Max 7
:
プログラムの説明
メインパッチ
OSC-route
3
turn2
turn0
turn1
select
4
5
3
start
metro
counter
if
ave.js
javascript
ave.js
3
2
3
200
3
1
3
3
2
1
tempo.js
javascript
1
BPM
ave.js
1
sum.js
2
javascript
judge
2
3
5
6
2
midi
2
seq
5
delay
counter
4
counter
judge
counter
:
Group Report of 2015 SISP
- 17 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
ave.js
3
3
3
2
ave.js
a, b, c
if
min
max
200
max
1
min
2
max
a, b, c
1
min
3
2
200
1
3
3
1
2
:
sum.js
ave.js
1
1
0
2
1
sum
sum
1
2
8
:
サブパッチ (judge)
sum.js
3
judge
2
3
2
2
2
if
1
3
4
2
1
2
8
2
2
0 2
judge
3 5
judge
6
1
judge
counter
8
:
4.1.3
音楽班
出力する音楽の提案
MIDI
Group Report of 2015 SISP
- 18 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
MIDI
:
MIDI ファイル作製
MIDI
MIDI
MIDI
”sakura[4]”
sakura
4.2 MIDI
sakura
:
MIDI ファイルの出力
MIDI
Max
MIDI
MIDI
3
0 2
3 5
MIDI
Group Report of 2015 SISP
4.1
E
2
- 19 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
:
後期
4.2
Kinect 班
4.2.1
Kinect 班の概要
Kinect
Kinect
2
• 1.
• 2.
Max
Patch
Kinect
Kinect v2
Kinect
Microsoft
Xbox 360
USB
Windows
Kinect v2
Kinect
SDK
Xbox One
Kinect v2
PC
4.1
4.1 Kinect v2
OS
Windows 8, Windows 8.1
2.66GHz
RAM
2.0GB
GPU
DirectX 11
USB
USB3.0
C
for Desktop
Control(
Visual Studio Express 2013
WPF
Max
Open Sound
OSC
:
実行環境の設定
Kinect
3
Group Report of 2015 SISP
- 20 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
Kinect
1.5m
40cm
(
4.3)
4.3
Kinect v2
C
Visual Studio Express 2013 for Desktop
WPF
Kinect
:
OpenSoundControl
Kinect
Max
Open Sound Control[5]
OSC
MIDI
C
Rug.Osc [6]
OSC
OpenSoundControl
• OpenSoundControl osc = new OpenSoundControl(”IP
”,
);
IP
• OpenSoundControl.Send(”OSC
”, ”
”);
OSC
1
”1”
OSC
osc.Send(”turn1”, ”1”);
/turn1
1
OSC
:
Group Report of 2015 SISP
- 21 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
計画
Kinect
4.2
Kinect
2
Kinect
Kinect
Kinect v2
4.2 Kinect
Kinect C
10/23
10/28
10/28
OSC
10/29
10/29
10/30
11/2
Processing
11/2
Kinect
11/6
Max
11/6
11/6
11/6
• Kinect C
Kinect
•
Kinect
•
Kinect
• OSC
OSC
•
Group Report of 2015 SISP
- 22 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
•
3
•
• Processing
Processing
• Kinect
Processing
Kinect
Max
•
Max
Max
•
•
:
前期に作成したプログラムとの比較
Kinect
Kinect
1
Kinect
Y
C
1
1
:
プログラムの構成
Kinect
4.4
Time, Data, DynamicPoint
3
Time
System.Diagnostics
Stopwatch
Time
Time
GetTime
Group Report of 2015 SISP
- 23 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
4.4
MainWindow
Kinect
Data
DynamicPoint
Data
List
AddPoint
CheckUpDown
:
振った判定のアルゴリズム
4.5
0
0
4.6
CheckUpDown
•
•
Group Report of 2015 SISP
- 24 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
4.5
4.6 CheckUpDown
y
1
•
15
15
1
•
y
(
)
Group Report of 2015 SISP
2
- 25 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
:
Kinect 班のまとめ
OSC
Kinect
OSC
Max
OSC
:
4.2.2
同期班
同期判定班の概要
Max 7
4
3
11
(vstVirtual Studio Technology)
ave.js
3
javascript
sum.js
javascript
ave.js
ave.js
2
vst
Kinect
4
:
プログラムの説明
sum.js
javascript
Group Report of 2015 SISP
(
4.7)
ave.js
- 26 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
cnt
cnt
cnt
re1
4.7 sum.js
:
サブパッチ (judge)
(
4.8)
sum.js
3
1
3
1
2
3
if
1
1
1
0
1
0
4
1
Group Report of 2015 SISP
- 27 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
4.8
(judge)
:
メインパッチ
turn2
OSC-route
3
turn3
turn1
select
4
time
javascript
ctempo.js
4
BPM120
BPM
5
1
1024
500
start1024
start
metro
counter
input
ave.js
javascript
3
2/5
1
3
2
0
2 3
3
turn1,turn2,turn3
6 b,c
0 1
1 2
3
a,b,c
a,b,c
5 a,b
2 a
7 a,c
4 c
3 b
1
0
2
sum.js
3
javascript
:
サブパッチ (time)
4
2
time
1
counter
if
Group Report of 2015 SISP
- 28 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
:
ctempo.js
javascript
time
BPM
1
array
1
4
60000
BPM
:
サブパッチ (input)
:
ave.js
javascript
3
1
2/5
1
1
0
0 1
turn1,turn2,turn3
6 b,c
1 2
1
2 3
3
a,b,c
a,b,c
5 a,b
7 a,c
4 c
2 a
3 b
1
a,b,c
0
if
0
2/5
ave
re
hu
ave,re,hu
2/5
1
1
:
4.2.3
音楽班
音楽班の概要
2
MIDI
8
Group Report of 2015 SISP
- 29 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
Varni, Marie, Bruce & Trainor (2010)
50
MIDI
C4
1
MIDI
MIDI
MIDI
2
Max
3
MIDI
:
4.9
Group Report of 2015 SISP
- 30 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
音楽ファイルを作成する
MIDI
Domino
MIDI
Domino
TAKABOSOFT
MIDI
sakura
Domino
sakura
Domino
sakura
sakura
Domino
Domino
sakura
MIDI
Domino
MIDI
Max
format 0
Domino
MIDI
4.10 Domino
:
新規で作成した音楽での各パートについて
Domino
MIDI
1
Group Report of 2015 SISP
- 31 -
4
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
4
4
4.11
8
MIDI
1
8
C2
1
4
1
4.12
1
4
3
MIDI
3
Group Report of 2015 SISP
- 32 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
4.13
MIDI
2
MIDI
4
4.14
8
8
4.15
:
Group Report of 2015 SISP
- 33 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
既存の音楽から作成する方法について
MIDI
Varni
1
(2010)
4
Royksopp
only this moment
MIDI
wavetone
Domino
wavetone
MIDI
Ackie Sound
MP3
wav
only this moment
4.16
2
C5
MIDI
wavetone
MIDI
Domino
C5
1
1
:
Group Report of 2015 SISP
- 34 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
4.17
Max との接続
Max
MIDI
Domino
VST
Max
MIDI
VST
Virtual Sound Technology
Qubase
Steinberg
VST instrument(VSTi)
VST effect(VSTe)
GUI
VSTi
VST
2
DR-II Fusion
Synth1
2
4.18 DR-FUSION
:
Group Report of 2015 SISP
- 35 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
4.19 Synth1
音楽班でのまとめ
MIDI
MIDI
:
4.2.4
照明班
照明班の概要
8
1
1
[14]
1
:
照明班の目標
3
1
Group Report of 2015 SISP
- 36 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
2
3
Max
:
目標達成のプロセス
2
:
表現方法の案出し
LED
Rainbowcube[12]
:
材料の調達
Seeed Studio
cube
4
Rainbow cube kit[12]
64
LED
Rainbowcube
Arduino
Rainbow
Arduino[8]
LED
Rainbowduino[13]
:
Group Report of 2015 SISP
- 37 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
開発環境の整備
Rainbowduino
Arduino 1.6.5
Arduino1.6.5
Rain-
bowduino
Arduino 1.6.5
Arduino
Rainbowduino
Arduino
Arduino uno[9]
Arduino Duemilanove[10] or
Diecimila[11]
Rainbowduino
seeed
studio wiki[13]
:
プログラムのプロトタイプの作成
Max
arduino
maru.ino
Rainbowduino
Rb.setPixelZXY
1
for
1
LED
delay
LED
random
24bit
RGB
:
dannMove.ino
LED
Rb.setPixelZXY
1
Rainbowduino
PlasmaCube
:
suuji.ino
0
4
4
9
LED
Rb.setPixelZXY
LED
1
0
5
Group Report of 2015 SISP
- 38 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
:
guruguru.ino
Rb.setPixelZXY
for
LED
LED
delay
LED
1
:
発表時の準備
Max
Max
Max
Max
:
Max とのデータ通信
Maxuino
Max
Max
Maxuino
Max
Maxuino
Arduino
Arduino
Maxuino
Maxuino
Maxuino
Rainbowduino
arduino
Rainbowduino
Arduino uno
Duemilanove or Diecimila
Maxuino
Serial
Serial
Rainbowduino
Max
Max
Max
Rainbowduino
Max
Serial
:
アクリルボックスの作成
Rainbow cube
15 ฀
Rainbow cube
Group Report of 2015 SISP
,Rainbowduino
- 39 -
USB
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
2
2mm
,
Adobe Illustrator
Rainbowcube
25 ฀
55 ฀
5mm
:
発表に向けた表現の改良
:
最終発表用のプログラム作成
doai3.ino
LED
Rb.setPixelZXY
3
Rainbow cube
A B C
A
B
B
A
C
C
for
LED
xy
A,B,C
Rainbowduino
Rb.setPixelZXY
Group Report of 2015 SISP
PlasmaCube1
RGB
- 40 -
100
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
:
Serial-Arduino.ino
Serial
Rainbowduino
Max
Arduino
9600bps
Serial.read()
LED
Serial.available()
doai3.ino
LED
:
2 月の発表における改良点
12
delay
15 ฀
Rainbowcube
12
2m
2
2
プログラムの改良
2
delay
4.3
4.3.1
デザイン班
デザイン班ができるまで
Kinect
3
Kinect
1
kinect
C
kinect
2
Kinect
Group Report of 2015 SISP
- 41 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
4.3.2
目的
Max
Processing
4.20
4.20
2
•
•
4.3.3
システムの詳細
3
Group Report of 2015 SISP
- 42 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
A
A
A
1
16
48
4.21
1
[1]
[2]
[3]
4.21
16
A
0
Max
7
4.3
4.3
0,1,2,3
4
5
6
7
4.3
Max
0,1,2,3
0
0
4
7
2
4.22
Processing
Max
Group Report of 2015 SISP
OSC
- 43 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
4.22
1
PC
2
running man
PC
Ripple
running man
OSC
3
frameRate()
4
image()
sphere()
Y
translate()
specular()
ambientLight()
lightSpecular() directionalLight()
camera()
Ripple
3
ellipse()
3
running man
running man
Group Report of 2015 SISP
background
- 44 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
4.3.4
システムの展望
2D
3D
Kinect
:
Group Report of 2015 SISP
- 45 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
第 5 章 結果
5.1
前期
前期の結果
5.1.1
PC
3
3
PC
Processing
PC
MAX/MSP
OSC
3
2
MAX
midi
javascript
2
4
:
中間発表
5.1.2
27
7
10
,
(
Group Report of 2015 SISP
- 46 -
5.1)
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
6.6
6.9
5.1
:
Group Report of 2015 SISP
- 47 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
後期
5.2
後期の結果
5.2.1
Kinect
3
3
Kinect
Kinect
Kinect
3
3
OSC
Kinect
Kinect
3
midi
midi
midi
2
RainbowCube
Processing
:
最終発表の成果
5.2.2
2015
12
11
20
3
20
3
10
20
3
3
2
3
10
Group Report of 2015 SISP
- 48 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
10
6.06
6.77
:
5.3
成果の評価
1
Processing
Max
Max
Max
Max
Max
Max
Processing
Processing
2
Processing
2
Max
3
Processing
Max
Max
OSC
Max
Processing
200
2
2
2
Group Report of 2015 SISP
1
- 49 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
MIDI
”sakura”
MIDI
3
MIDI
3
Max
3
3
2
Kinect
5
Kinect
Kinect
Kinect
C
C
Max
C
Max
Kinect v2
Visual Studio Express 2013
OSC
C
C
C
Kinect
MIDI
Domino
3
MAX
Group Report of 2015 SISP
- 50 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
Domino
VST
Max
RainbowCube kit
RainbowCube kit
Arduino
Arduino
Max
Serial
Max
Rainbowduino
Max
Rainbowduino
Max
Arduino
Processing
Processing
Max
Processing
OSC
PC
:
Group Report of 2015 SISP
- 51 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
第 6 章 今後の課題と展望
6.1
前期の課題と展望
PC
Max
PC
6.1
:
6.2
後期の課題と展望
Xbox
kinect
kinect
RGB
Processing
Group Report of 2015 SISP
- 52 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
RainbowCube
RainbowCube
RainbowCube
:
6.2
6.3
今後の展望
:
Group Report of 2015 SISP
- 53 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
6.3.1
ユーザーのモチベーションを上げたい
DanceEvolution
6.3
6.3 DanceEvolution
:
6.3.2
全く新しい表現を提案する
kinect
:
6.3.3
実験
:
Group Report of 2015 SISP
- 54 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
6.4
6.4
中間発表のアンケート結果
中間発表の日時・場所
6.4.1
27
7
10
14:50
18:00
1
:
6.4.2
アンケート結果
•
•
•
•
•
•
Group Report of 2015 SISP
- 55 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
• 1
•
•
•
•
•
(
•
)
•
•
Max
•
•
•
•
•
•
•
•
•
• Web
(
•
)
•
•
•
?
•
•
•
•
•
• UX,
:
6.5
最終発表のアンケート結果
最終発表の日時・場所
6.5.1
27
12
11
14:50
18:00
1
:
Group Report of 2015 SISP
- 56 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
6.5.2
アンケート結果
•
•
•
•
•
•
• 1
•
•
block diagram
•
•
•
•
•
•
•
•
•
•
•
•
•
LED
•
•
!
•
• Kinect
•
•
•
•
•
•
•
:
Group Report of 2015 SISP
- 57 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
付録 A
新規習得技術
• Max
• processing
• JaveScript
• sakura
• TeX
• Kinect V2
• Arduino
• C
• Open Sound Control
Group Report of 2015 SISP
- 58 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
付録 B
活用した講義
•
•
• Tex
•
•
Group Report of 2015 SISP
- 59 -
Group Number 20
PDF Compressor Pro
Musical and Visual Expression of Best Synchronization
参考文献
[1] Cycling ’74
MAX 7 —
&
- MI7
Japan. http://www.mi7.co.jp/products/cycling74/max/.
2016
1
13
13
.
2016
1
13
.
2016
.
[3] Xbox One Kinect
. http://www.xbox.com/ja-JP/xbox-one/accessories/kinect-
for-xbox-one/#fbid=e1ZZ4JJjA4Q.
13
1
13
[2] Processing.org. https://processing.org/.
1
2016
2016
1
13
.
2016
1
.
[4]
. http://oto.chu.jp/top/.
2016
1
13
2015
9
27
.
.
[5] openFramewoks - OSC (Open Sound Control)
—
yoppa.org. http://yoppa.org/ma2 10/2279.html.
2016
1
13
2016
1
13
.
.
[6] rugcode / Rug.Osc - Bitbucket. https://bitbucket.org/rugcode/rug.osc.
1
13
.
2016
1
13
2016
.
[7] Hove, MJ, Marie, C, Bruce, IC, and Trainor, LJ (2014). Superior time perception for
lower musical pitch explains why bass-ranged instruments lay down musical rhythms..
Proc Natl Acad Sci U S A, 111(28), 10383-8
[8] Arduino-Home. https://www.arduino.cc/.
1
10
2016
1
10
.
2016
.
[9] Arduino UNO & Genuino UNO. https://www.arduino.cc/en/Main/ArduinoBoardUno.
2016
1
10
.
2016
1
10
.
[10] Arduino Duemilanove. https://www.arduino.cc/en/Main/ArduinoBoardDuemilanove.
2016
1
10
.
2016
1
10
.
[11] Arduino Diecimila. https://www.arduino.cc/en/Main/ArduinoBoardDiecimila.
2016
1
10
.
2016
1
10
.
[12] Rainbow Cube kit RGB 4X4X4. http://www.seeedstudio.com/depot/Rainbow-Cube-kitRGB-4X4X4-Rainbowduino-Compatible-p-596.html.
2016
1
10
2016
1
10
.
.
[13] Rainbowduino v3.0. http://www.seeedstudio.com/wiki/Rainbowduino v3.0.
2015
8
25
[14]
.
2015
.
12
21
.
.
. 1972.
[15]
. http://www.kitex.co.jp/visual/visual.html.
2016
1
2011
12
14
.
13
Group Report of 2015 SISP
- 60 -
Group Number 20