[Meeting] 12.22

Interface:
- Load photos
- Classify by timing first
- Offer feature selection toolbar to classify the required category

[Meeting] 12.16

Current Progress:
SVM testing, Interface building, Feature extraction Revising.

Interface Specification:
1. Server:
- Database
- User, Password
- User, Class
- Class, PhotoPath
- Online
- Offline
- Users' individual folder
- Store photos in each folder
2. Client:
- Upload
- Download
- View
- Manual classification
- Personalized interface
- Group(?)

Classification Process:
1. Reaction Diagram














Next Meeting:
12/22 Mon.

[Memo] about SVM

http://www.langtech.org.cn/index.php/uid-507-action-viewspace-itemid-156

http://www.csie.ntu.edu.tw/~piaip/docs/svm/

http://www.wretch.cc/blog/emn178/11108736

[Meeting] 12.9

Today's work:
Setup the machine

Task:
1. Setup Matlab7.2 that can convert to library of .Net and test how to communicate with C#
2. Design CBIR function
3. Implement SVM by Matlab
- http://www.csie.ntu.edu.tw/~cjlin/libsvm/
- http://diary.blog.yam.com/yyblog/article/6193250
- http://luzhenbo.88uu.com.cn/Internet/libsvm_introduction_study.htm
- http://hi.baidu.com/obgnim/blog/item/41f39bdd44c73ee977c638c0.html
- http://www.csie.ntu.edu.tw/~cjlin/papers/guide/guide.pdf
4. Fetch metadata of photos
5. Store the features to database
6. Tune the weight of the fusion between content-based and metadata features
7. Design the interface

Specification:
1. Server system
- 2, 3, 6
- Communicate with SQL server
- Contains user management system

2. Client program
- Can upload photos to server

Next Meeting:
12/16 Tue.

[Meeting with Winston] 12.8

Methods of classification :
1. SVM

Features:
1. GPS
2. metadata+concept+time
3. EXIF-perl

[Meeting] 12.4

Today's work:
Determine the Automatical Classification Album be our topic of final project.

Schema:
1. Classify the photos in album.
2. Find the similar pictures in networking website.

Task:
1. Survey the two open source album systems
- http://www.phpalbum.net/
- http://gallery.menalto.com/
2. Survey the php framework
- http://www.codeigniter.com/
- http://www.php.net/manual/en/ (php manual)
3. Web Resources
- http://neural.cs.nthu.edu.tw/jang/
- Install http://doublekai.org/docs/CI_Install_Guide/CI.html
Questions:
1. Practical and creativity?
2. Communicate with PHP and Matlab?
3. How to retrieve the tag from photo?
4. Another interesting idea in album system?

Next meeting:
12/9 Tue.

[Meeting] 12.2

Today's work:
1. We've finished testing the face recognition of openCV. And it can identify the face of Lena successfully.

Schema:
1. Find the region of face from OpenCV (C++/Python)
- Find boundary of the face
- Normalize
- Map to low dimension
- Store location
2. Extract the features and classify pictures by SVM (Matlab/PHP/Python)
3. Store the features to database (MySQL)
4. Retrieve pictures form database to satisfy the query requirement (PHP/Python)
5. Display the result on the website (JavaScript)

Task:
1. Survey Python
- Tutorial http://www.freebsd.org.hk/html/python/tut_tw/tut.html
- Download http://www.python.org/download/
- 2, 3, 4, (5, 6, 9)
- Make document
- Useful Python framework
- Django http://www.djangoproject.com/
- TurboGears http://turbogears.org/
2. Survey OpenCV
- How to pre-process image

Questions:
1. Could a picture map to a location and store them before?
2. How to call Matlab from PHP or C# ?

Next meeting:
12/9 Tue.

[Memo] About OpenCV

How to use OpenCV?

1. OpenCV Wiki in English
http://opencv.willowgarage.com/wiki/Welcome
2. OpenCV Instruction in traditional Chinese by NCKU CSIE VISION SYSTEM LAB
http://euleramon.pixnet.net/blog/post/22763756
Download : http://vision.csie.ncku.edu.tw/%7Eeuleramon/openCV_DIY.pdf
I recommand use OpenCV under .Net 2005 VC++ or .Net 2008 VC++
3. Try Example of Face Recognition
http://www.opencv.org.cn/index.php/%E4%BA%BA%E8%84%B8%E6%A3%80%E6%B5%8B
4. Tutorial for using OpenCV
DevC++ : http://yester-place.blogspot.com/2008/06/dev-copencv.html
BCB : http://plog.ipobar.com/cheehong86/article/2928
Linux : http://www.cnblogs.com/oomusou/archive/2008/06/05/opencv_linux_install.html
5. Other Reference
http://209.85.173.132/search?q=cache:T4XFnMMHCgYJ:blog.sina.com.tw/overturey/article.php%3Fpbgid%3D5714%26entryid%3D7403+opencv+face+recognition&hl=zh-TW&ct=clnk&cd=3&gl=tw&lr=lang_zh-TW

[Memo] 12/1

Comparision between Algorithms:

• edge detection，skin color及motion等方法都可以很快找到人臉範圍，但較容易受到外界環境干擾。
• PCA，LDA，FA、SVM及neural network等方法雖然有不錯的偵測率，但需花費很長的時間。
• A Face-Finding Search Engine: http://www.technologyreview.com/communications/21384/?a=f for low-resolution images."Super-resolution will give you an interpolated image that looks better," says Hennings-Yeomans, "but it will have distortions like noise or artificial [features]."
• Face recognition: http://image.cse.nsysu.edu.tw/research/Delaunay/delaunay.htm Advantage:unique, local re-meshing, arrangement invariance and can detect edges. 可利用三角形結構作為類神經網路的輸入。
  •人臉資料庫由麻省理工學院媒體實驗室(MIT Media Laboratory)取得http://vismod.www.media.mit.edu/vismod/demos/photobook (144位不同人正面影像，每個人有二到四張不同之臉部正面影像，共有308張影像)

---------------------------------------------------------------------

人臉識別發展: http://140.113.87.114/cvrc/edm/vol_7/tech1.htm
人臉辨識相關網誌: http://www.im.ntu.edu.tw/~d93001/blog/index.php?d=06&m=11&y=08&category=4
人臉辨識系統(流程與演算法): http://140.128.102.71/research/mn/02/index.htm

openCV學習筆記與心得(含程式範例): http://funp.com/t136721#p=136721
openCV自學手冊: http://vision.csie.ncku.edu.tw/~euleramon/openCV_DIY.pdf

橢圓人臉偵測+膚色偵測+轉黑白+轉輪廓(含程式範例): http://delphi.ktop.com.tw/board.php?cid=31&fid=79&tid=73445

[Meeting] 11.27

Topic: mypikaray, a social networking website with face recognition and retrieval

Objective: Search for people by photos

Methods:
1. CBIR
- Global color space
- Garbor
- Search for what feature is suitable for face identification
- Ask Winston
2. OpenCV
3. php+mySQL+Apache
4. Website design
5. jQuery

Resources:
1. AppServ:
http://sourceforge.net/project/downloading.php?groupname=appserv&filename=appserv-win32-2.5.10.exe&use_mirror=jaist
2. jQuery:
http://www.jquery.com.tw/
3.OpenCV:
http://www.opencv.org.cn/index.php?title=%E9%A6%96%E9%A1%B5&variant=zh-tw
4. Face recognition:
http://image.cse.nsysu.edu.tw/research/Delaunay/delaunay.htm

Task:
1. Survey the CBIR algorithm on face recognition
2. Study and test OpenCV

Next meeting:
12/2(二)

[Reference Article] A Face-Finding Search Engine

http://www.technologyreview.com/communications/21384/?a=f

Open source album system

Here are some websites about open source album system.
And it might be useful when building our site.

http://www.phpalbum.net/

http://www.plogger.org/

http://gallery.menalto.com/

http://www.econsultant.com/i-want-open-source-software/index.html

http://www.techsupportalert.com/content/open-source-album-art-finder.htm

Project idea

Current idea:
We'll build a simple social networking website that includes the album system. The key feature of the album system is automatic classification. If users want to upload lots of photo to the album system, they just click the upload button, and the website will classify all these photo automatically based on CBIR technique.

Besides, another feature of this social networking website is that users can search other user's profile just by photo.

However, the project idea have not proposed completely.
And we'll keep discussing and refining our thought.

2008 Fall MMAI

This blog is for final project of MMAI in Fall, 2008.
Our team is mypikaray.
And the team members are Chien-Ray Kung, Yi-Chun Chen, and Heng-Yu Chi.

Course website: http://www.csie.ntu.edu.tw/~winston/courses/mm.ana.idx/
Lecturer: Winston Hsu