USOO8902345B2

(12) United States Patent (10) Patent No.: US 8,902,345 B2

Park et al. (45) Date of Patent: Dec. 2, 2014
(54) METHOD AND APPARATUS FOR (58) Field of Classification Search
SYNTHESIZING TWO ORMORE IMAGES USPC ............ 348/333.02–333.06, 218.1, 239, 241,
TOGETHER WITH ONE ANOTHERVA 348/246, 208.4
DIVIDED DISPLAY SCREEN See application file for complete search history.
(56) References Cited
(75) Inventors: Wan-je Park, Seongnam-si (KR):
Hye-jin Kim, Seoul (KR); Tai-hoon U.S. PATENT DOCUMENTS
Kim, Seoul (KR) 2003/0174217 A1* 9, 2003 Kito et al. .................. 348,231.2
2009/0303354 A1* 12/2009 Yanagi ........... ... 348/240.1
(73) Assignee: Samsung Electronics Co., Ltd., 2012/0075496 A1 3/2012 Akifusa et al. ..... ... 348,222.1
Suwon-si (KR) 2012/0163659 A1* 6, 2012 Asakura et al. ............... 382,103

(*) Notice: Subject to any disclaimer, the term of this FOREIGN PATENT DOCUMENTS
patent is extended or adjusted under 35 KR 10-2005-01-16699. A 12/2005
U.S.C. 154(b) by 62 days. KR 10-1050662 B1 T 2011

(21) Appl. No.: 13/603,592 * cited by examiner

Primary Examiner — Mekonnen Dagnew
(22) Filed: Sep. 5, 2012 (74) Attorney, Agent, or Firm — Drinker Biddle & Reath
LLP
(65) Prior Publication Data (57) ABSTRACT
US 2013/O162878A1 Jun. 27, 2013 A digital photographing apparatus and a method of control
ling the same. The method including setting a division frame
(30) Foreign Application Priority Data configured by dividing a display screen; displaying a first
input image in a first region of the set division frame; display
Dec. 23, 2011 (KR) ........................ 10-2011-O141731 ing the first input image captured according to a first photo
graphing signal, in the first region; displaying a second input
(51) Int. Cl. image in a second region of the set division frame; and dis
H04N 5/222 (2006.01) playing the second input image captured according to a sec
(52) U.S. Cl. ond photographing signal in the second region.
USPC ..................................................... 348/333.05 18 Claims, 17 Drawing Sheets
1OO
170
MANIPULATION
UNIT
115 12O 2OO 13O

O IMAGING
DEVICE
ANALOG SIGNAL
PROCESSOR
PROGRAM
STORING
UNIT

14O
MAGING DEVICE BUFFER
LENS IRIS CONTROL
DRIVING UNIT DRIVING UNIT UNIT STORING UNIT

15O
DATA
STORING UNIT

DISPLAY
DRIVING UNIT

DISPLAY UNIT
U.S. Patent US 8,902,345 B2

||
G
U.S. Patent Dec. 2, 2014 Sheet 2 of 17 US 8,902,345 B2

FIG 2
2OO

DIVISION FRAME SETTING UNIT 2O1

PHOTOGRAPHING CONTROL UNIT 2O2

BLUR PROCESSING UNIT 2O3

FFECT APPLYING UNIT 204

IMAGE SYNTHESIZING UNIT 205

DISPLAY CONTROL UNIT

STORAGE CONTROL UNIT

U.S. Patent Dec. 2, 2014 Sheet 3 of 17 US 8,902,345 B2

FIG 3

SET DIVISION FRAME CONFIGURED BY 3OO

DIVIDING DISPLAY SCREEN

INPUT AND DISPLAY FIRST IMAGE IN

FIRST REGION OF DIVISION FRAME

IS SHUTTER-RELEASE
SIGNAL INPUTP

YES
CAPTURE FIRST MAGE 306

DISPLAY FIRST CAPTURED IMAGEN

FIRST REGION 3O8

INPUT AND DISPLAY SECOND IMAGEN

SECOND REGION OF DIVISION FRAME

IS SHUTTER-RELEASE
SIGNAL INPUTP NO

YES
CAPTURE SECOND IMAGE 314

DISPLAY SECOND CAPTURED IMAGE 316

END
U.S. Patent Dec. 2, 2014 Sheet 4 of 17 US 8,902,345 B2

FIG. 4A

START

PROVIDE FRAME SELECTION MENU FOR-400

SELECTING ONE FROM AMONG A
PLURALITY OF DIVISION FRAMES

NO
S DIVISION
FRAME SELECTED P

YES
PROVIDE SELECTED DIVISION PROVIDE DEFAULT DIVISION
FRAME AS DIVISION FRAME FRAMEAS DIVISION FRAME

INPUT AND DISPLAY FIRST IMAGE IN

FIRST REGION OF DIVISION FRAME

IS THERE
REQUEST FOR CHANGING SIZE OF
DIVISION FRAME?

CHANGE SIZE OF DIVISION FRAME

IS SHUTTER
RELEASE SIGNAL INPUTP
U.S. Patent Dec. 2, 2014 Sheet 5 Of 17 US 8,902,345 B2

FIG. 4B

YES
CAPTURE FIRST MAGE 416

DISPLAY FIRST CAPTURED IMAGE IN FIRST REGION 418

INPUT AND DISPLAY SECOND IMAGE IN

SECOND REGION OF DIVISION FRAME

422
S SHUTTER
RELEASE SIGNAL INPUTP
YES
CAPTURE SECOND IMAGE 424

SYNTHESIZE FIRST CAPTURED IMAGE 426

AND SECOND CAPTURED IMAGE

DISPLAY SYNTHESIZED IMAGE 428

STORE 430

END
U.S. Patent Dec. 2, 2014 Sheet 6 of 17 US 8,902,345 B2

FIG. 5A
510

532 533

FIG. 5B
540 550
U.S. Patent Dec. 2, 2014 Sheet 7 Of 17 US 8,902,345 B2

540 560

FIG. 5D

570

15 Oc

AVA 4
SAMPLE IMAGE
U.S. Patent Dec. 2, 2014 Sheet 8 of 17 US 8,902,345 B2

632 633
U.S. Patent Dec. 2, 2014 Sheet 9 Of 17 US 8,902,345 B2

FIG. 6C
611

FIG. 7A
7OO 710

740
U.S. Patent Dec. 2, 2014 Sheet 10 of 17 US 8,902,345 B2

FIG 7B

PhOtO Size cond

at aZ

Quality con

760 M 761

771 770
U.S. Patent Dec. 2, 2014 Sheet 11 of 17 US 8,902,345 B2

FIG

FIG
U.S. Patent Dec. 2, 2014 Sheet 12 of 17 US 8,902,345 B2

FIG. 8A

811 812 813 810

FIG. 8B

NK
U.S. Patent Dec. 2, 2014 Sheet 13 of 17 US 8,902,345 B2

CA
--- or
CON 1 CON 2 CON 3

NORMAL -R ATURE
Cancel Cy

FIG. 8D
U.S. Patent Dec. 2, 2014 Sheet 14 of 17 US 8,902,345 B2

FIG. 9B

SAMPLE IMAGE

930 N DESCRIPTION OF
See SAMPLE IMAGE

910 911 912 913

U.S. Patent Dec. 2, 2014 Sheet 15 Of 17 US 8,902,345 B2

FIG. 9C
SAMPLE IMAGE

DESCRIPTION OF
SAMPLE IMAGE

91 O 911 912 913

1010
U.S. Patent Dec. 2, 2014 Sheet 16 of 17 US 8,902,345 B2

FIG. 11

11 OO

111 O
U.S. Patent Dec. 2, 2014 Sheet 17 Of 17 US 8,902,345 B2

FIG. 12

1200

121 O

13 OO

1310
 US 8,902,345 B2
1. 2
METHOD AND APPARATUS FOR The first input image or the second input image to which an
SYNTHESIZING TWO ORMORE IMAGES image processing effect selected using the selection menu is
TOGETHER WITH ONE ANOTHERVA applied, may be displayed.
DIVIDED DISPLAY SCREEN The method may further include: providing a frame selec
tion menu for selecting one from among a plurality of division
CROSS-REFERENCE TO RELATED PATENT frames; and displaying a sample image that is synthesized
APPLICATIONS using the division frame selected using the frame selection
C.
This application claims the benefit of Korean Patent Appli Information regarding the synthesized sample image may
cation No. 10-2011-0141731, filed on Dec. 23, 2011, in the 10
be displayed together with the synthesized sample image.
Korean Intellectual Property Office, the entire disclosure of According to another aspect of the invention, there is pro
which is incorporated herein by reference. vided a method of controlling a digital photographing appa
BACKGROUND ratus, the method including: providing a frame selection
15 menu including a plurality of division frames; dividing a
1. Field of the Invention display screen based on a division frame selected from among
One or more embodiments of the invention relate to a the plurality of division frames; displaying a first input image
digital photographing apparatus and a method of controlling in a first region of the division frame and capturing the first
the same that enables synthesizing images together. input image according to a first photographing signal; dis
2. Description of the Related Art playing the first captured input image in the first region;
Synthesized image are often pleasing to a user of a digital displaying a second image in a second of the division frame
camera. For example, Some digital cameras enable a user to and capturing the second input image according to a second
synthesize an image of a face with a background image of a photographing signal; displaying the second captured input
famous location. However, many current digital cameras (and image in the second region; and storing a synthesized image
more generally digital photographing apparatuses) do not 25 obtained by synthesizing the first captured input image and
provide users a convenient way to synthesize two or more the second captured input image.
images together with one another. According to another aspect of the invention, there is pro
vided a digital photographing apparatus including: a division
SUMMARY frame setting unit for setting a division frame configured by
30
dividing a display screen; a photographing control unit for
Therefore, there is a need in the art for a digital photograph controlling photographing of an input image according to a
ingapparatus and method of controlling the same, the method photographing signal; and a display control unit displaying
including: setting a division frame configured by dividing a the input image and an image obtained by capturing the input
display Screen; displaying a first input image in a first region
of the set division frame; displaying the first input image 35 image on the display Screen, wherein the display control unit
captured according to a first photographing signal, in the first displays a first input image in a first region of the set division
region; displaying a second input image in a second region of frame, displays the first input image captured according to a
the set division frame; and displaying the second input image first photographing signal in the first region, displays a second
captured according to a second photographing signal, in the input image in a second region of the set division frame, and
second region. 40 displays the second input image captured according to a sec
The method may further include synthesizing the first cap ond photographing signal in the second region.
tured input image and the second captured input image with The digital photographing apparatus may further include
each other and displaying the synthesized image. an image synthesizing unit for synthesizing the first captured
The method may further include storing the synthesized input image and the second captured input image, wherein the
image obtained by Synthesizing the first captured input image 45 display control unit displays the synthesized image.
and the second captured input image, as one image file. The division frame setting unit may provide a frame selec
The method may further include providing a frame selec tion menu for selecting one from among a plurality of division
tion menu for selecting one from among a plurality of division frames.
frames. The division frame setting unit may adjust a size of the set
The method may further include adjusting a size of the set 50
division frame.
division frame. The digital photographing apparatus may further include a
The method may further include blur processing a bound blur processing unit
ary region of the set division frame. for blur processing a boundary region of the set division
The method may further include: providing a selection frame.
menu for blur processing a boundary region of the set division 55
The digital photographing apparatus may further include a
frame; displaying sample images in the first region and the
second region, respectively, according to selection of the blur storage control unit for storing the synthesized image
processing: blur processing the boundary region based on the obtained by synthesizing the first captured input image and
displayed sample images; and blur processing a boundary the second captured input image, as one image file.
region between the first displayed input image or the second 60 The digital photographing apparatus may further include
displayed input image. an effect applying unit for applying an image processing
The method may further include determining an intensity effect selected using the selection menu including a plurality
of the blur processing. of image processing effects on the first displayed input image
The method may further include displaying a selection or the second displayed input image, wherein the display
menu including a plurality of image processing effects on the 65 control unit displays the first input image or the second input
first displayed input image and the second displayed input image to which the image processing effect selected using the
image. selection menu.
 US 8,902,345 B2
3 4
BRIEF DESCRIPTION OF THE DRAWINGS The lens unit 110 collects a light signal. The lens unit 110
includes a Zoom lens for reducing or increasing a viewing
The above and other features and advantages of the inven angle according to a focallength and a focus lens for adjusting
tion will become more apparent by describing in detail exem the focus on a Subject, and each of the Zoom lens and the focus
plary embodiments thereof with reference to the attached 5 lens may be a single lens or a group of a plurality of lenses.
drawings in which: The iris 112 regulates the light intensity of an incident light by
FIG. 1 is a diagram schematically illustrating a structure of controlling the amount of opening/closing thereof.
a digital camera as an example of a digital photographing The lens driving unit 111 and the iris driving unit 113 are
apparatus according to an embodiment of the invention; provided with a control signal from the DSP 200 to drive the
FIG. 2 is a detailed block diagram of an example of a digital 10 lens unit 110 and the iris 112. The lens driving unit 111
signal processor illustrated in FIG. 1; controls the position of a lens to adjust a focal length, and
FIG.3 is a flowchart illustrating an example of a method of performs auto focusing, Zooming, focusing operations, and
controlling a digital photographing apparatus, according to so forth. The iris driving unit 113 controls the amount of
an embodiment of the invention; opening/closing of the iris 112, and in particular, adjusts an f
FIG. 4 is a flowchart illustrating an example of a method of 15 number or an iris value to perform auto focusing, auto expo
controlling a digital photographing apparatus, according to Sure correction, focusing, depth-of-field (DOF) adjusting
another embodiment of the invention; operations, and the like.
FIGS. 5A through 5D are example views for explaining a The light signal passing through the lens unit 110 forms an
method of controlling a digital photographing apparatus, image of a Subject on a light-receiving Surface of the imaging
according to another embodiment of the invention; device 115. The imaging device 115 may be a charge-coupled
FIGS. 6A through 6C are example views for explaining a device (CCD), a complementary metal-oxide semiconductor
method of controlling a digital photographing apparatus, image sensor (CIS), or a high-speed image sensor which
according to another embodiment of the invention; converts the light signal into an electric signal. The sensitivity
FIGS. 7A through 7E are example views for explaining a of the imaging device 115 may be controlled by the imaging
method of controlling a digital photographing apparatus, 25 device control unit 116. The imaging device control unit 116
according to another embodiment of the invention; may control the imaging device 115 according to a control
FIGS. 8A through 8D are example views for explaining a signal, which is automatically generated by an image signal
method of controlling a digital photographing apparatus, input in real time or manually input by the user's manipula
according to another embodiment of the invention; tion. The exposure time of the imaging device 115 is con
FIGS. 9A through 9C are example views for explaining a 30 trolled by a shutter (not shown). The shutter may be a
method of controlling a digital photographing apparatus, mechanical shutter for adjusting incidence of light by moving
according to another embodiment of the invention; and a shade or an electronic shutter for controlling exposure by
FIGS. 10 through 13 are example views of synthesized Supplying an electric signal.
images, which are captured using each of the methods illus The analog signal processor 120 performs noise reduction
trated in FIG. 3 through FIGS. 9A through9C. 35 processing, gain control, waveform standardization, analog
digital conversion, and the like with respect to the analog
DETAILED DESCRIPTION signal provided from the imaging device 115.
Through the manipulating unit 170, a control signal can be
The invention will be described below in more detail with externally input, for example, from a user. The manipulating
reference to the accompanying drawings, in which exemplary 40 unit 170 includes a shutter-release button for inputting a shut
embodiments of the invention are shown. Those components ter-release signal which exposes the imaging device 115 to
that are the same or are in correspondence are rendered the light for a predetermined time to photograph the Subject, a
same reference numeral regardless of the figure number, and moving image recording button for inputting a moving image
redundant explanations are omitted. recording start signal and a moving image recording end
FIG. 1 is a diagram Schematically illustrating the structure 45 signal to photograph a moving image, a power button for
of a digital photographing apparatus according to an embodi inputting a control signal for controlling power-on/off, a
ment of the invention. A digital camera 100 is described as an wide-angle Zoom button and a telephoto Zoom button for
example of the digital photographing apparatus according to increasing or reducing the angle of view, respectively, and
an embodiment of the invention. However, the digital photo other function buttons for mode selection from a text input
graphing apparatus is not limited to the digital camera 100 50 mode, a photographing mode, a play mode, and the like, a
illustrated in FIG. 1, and may also be applied to other digital white balance setting function, an exposure setting function,
devices. Examples of other digital devices include a Smart and so forth. The manipulating unit 170 may be implemented
phone including a camera module, a mobile phone, a personal with, without being limited to, various buttons as described
digital assistant (PDA), a portable multimedia player (PMP), above, but may also be implemented in any form of user input,
and a camcorder. 55 Such as a keyboard, a touch pad, a touch screen, a remote
The digital camera 100 according to the current embodi control, or the like.
ment may include a lens unit 110, a lens driving unit 111, an The digital camera 100 may include the program storing
iris 112, an iris driving unit 113, an imaging device 115, an unit 130 for storing programs of an operating system and an
imaging device control unit 116, an analog signal processor application system of digital camera 100, the buffer storing
120, a program storing unit 130, a buffer storing unit 140, a 60 unit 140 for temporarily storing data required during an
data storing unit 150, a display driving unit 162, a display unit operation or storing result data, and the data storing unit 150
160, a digital signal processor (DSP) 200, and a manipulating for storing data required for programs. Such as an image file
unit 170. Herein, the lens unit 110, the lens driving unit 111, corresponding to an image signal and a moving image file.
the iris 112, the iris driving unit 113, the imaging device 115, The digital camera 100 also includes the display unit 160
the imaging device control unit 116, and the analog signal 65 for displaying an operational State of the digital camera100 or
processor 120 may be collectively referred to as a photo still image data or moving image data obtained by the digital
graphing unit. camera 100. The display unit 160 may provide visual infor
 US 8,902,345 B2
5 6
mation and/or audible information to the user. To provide include a division frame setting unit 201, a photographing
visual information, the display unit 160 may include, for control unit 202, a blur processing unit 203, an effect applying
example, a liquid crystal display (LCD) or an organic light unit 204, an image synthesizing unit 205, a display control
emitting diode (OLED) display. The display driving unit 162 unit 206, and a storage control unit 207.
provides a drive signal to the display unit 160. In some The division frame setting unit 201 may set a division
embodiments of the invention, the display unit 160 may be frame configured by dividing a display Screen. In some
disposed at a rear side of the display camera 100, i.e., on a embodiments, the display screen refers to the entire screen of
plane on which manipulation panels are disposed. In addition, the display unit 160. The division frame may include hori
the display unit 160 may be disposed at a front side of the Zontal-2-division, horizontal-3-division, vertical-2-division,
digital camera 100 to face the subject, or may be disposed at 10 or vertical-3-division. Although it is described that the dis
the rear side of the digital camera 100 in a default state and play screen is divided in a horizontal or vertical direction, the
then may be flipped upwards to face the subject. Also, the invention is not limited thereto, and a variety of types of
display unit 160 may be implemented with a dual LCD and division may be possible. For example, the display Screen
thus may be disposed at the rear and front sides of the digital may be divided diagonally or in a shape that accommodates
camera 100, respectively. 15 Subject shapes within images. In addition, the division frame
The digital camera 100 also includes the DSP 200 for setting unit 201 may provide a frame selection menu includ
processing an input image signal and controlling components ing a plurality of division frames having various shapes, for
of the digital camera 100 according to the input image signal example, horizontal-2-division, horizontal-3-division, Verti
or an externally input signal. The DSP 200 may perform cal-2-division, or vertical-3-division, and may divide the dis
image signal processing for quality improvement, Such as play Screen based on one division frame selected by the user.
noise reduction, gamma correction, color filter array interpo In addition, the division frame setting unit 201 may provide
lation, color matrix, color correction, and color enhancement, an interface for adjusting the size of a frame according to
with respect to input image data. The DSP 200 also may user's selection, for example, by touching the boundary
compress the image data generated by performing image region of the division frame, and may provide the division
signal processing for quality improvement to generate an 25 frame having the adjusted size according to user's election,
image file, or may restore the image data from the image file. for example, by dragging a boundary line. Although it is
An image compression format may be a reversible format or described that the size of the division frame is adjusted
an irreversible format. The compressed data may be stored in according to a users touching and dragging operation,
the data storing unit 150. The DSP 200 may also functionally embodiments of the invention are not limited thereto, and the
perform indistinctness processing, color processing, blur pro 30 size of the division frame may also be adjusted using other
cessing, edge emphasis processing, image interpretation pro interfaces, for example, using manipulation keys.
cessing, image recognition processing, image effect process The photographing control unit 202 may control photo
ing, and the like. The image recognition processing may graphing of an input image according to a photographing
include face recognition and scene recognition. For example, signal. The photographing control unit 202 may control pho
luminance level adjustment, color correction, contrast adjust 35 tographing of the input image according to a shutter-release
ment, contour emphasis adjustment, screen dividing process signal generated when a shutter-release button disposed on
ing, image generation and synthesis processing, and the like the manipulating unit 170 is pressed. Photographing control
may be performed by the DSP 200 for image and face recog may be performed according to a general photographing con
nition. trol process. For example, when a first shutter-release signal
The DSP 200 may execute a program stored in the program 40 ofa half shutter or shutter-release signal is input from an input
storing unit 130 or include a separate module to generate a image or a live view image, a focus value may be obtained by
control signal for controlling auto focusing, Zooming, focus performing focusing in a focus region, and focus control for
changing, and auto exposure correction operations, provide moving a focus lens based on the focus value may be per
the control signal to the lens driving unit 111, the iris driving formed, and an appropriate exposure value may be controlled
unit 113, and the imaging device control unit 116, and col 45 according to the light intensity of incident light, and exposure
lectively control operations of components included in the control for controlling an iris value and a shutter speed may be
digital camera 100, such as a shutter, a flash, and the like. performed. Then, when a second shutter-release signal of a
In some embodiments of the invention, the DSP 200 may full shutter or shutter-release signal is input, the input image
provide a division frame configured by dividing a screen of may be captured.
the display unit 160. The DSP 200 may display an image 50 The blur processing unit 203 performs blur processing in a
captured by performing a photographing operation on a live particular region of the input image, or a sample image. Blur
view image displayed in a first region of the division frame. processing refers to image processing for making an image
The DSP 200 may display an image captured by performing Smooth by removing detailed parts of an arbitrary image. Blur
a photographing operation on a live view image displayed in processing or blurring may be performed using a filter for
a second region of the division frame. The DSP 200 may 55 averaging values of pixels, for example, a low pass filter or a
synthesize the images, which are captured in the first and Gaussian blur filter. Although it is described that blur pro
second regions of the division frame, to store the synthesized cessing is performed using an average filter, a low pass filter,
images as one image file. or a Gaussian blur filter, the invention is not limited thereto,
In some embodiments of the invention, the DSP 200 may and other various blur processing methods may also be used.
provide a blur processing effect in a boundary region of the 60 In some embodiments of the invention, the blur processing
division frame. The DSP 200 may provide a sample image to unit 203 may perform blur processing in the boundary region
predict a blur effect in advance. The DSP 200 may store a of the division frame to prevent the boundary region from
plurality of images captured using the division frame by appearing artificial when captured images are synthesized at
applying various image processing effects, together with vari each division frame. In addition, the blur processing unit 203
ous effects. 65 may perform blur processing on the sample image. Here, the
FIG. 2 is a detailed block diagram of an example of the DSP sample image is a previously-captured image or a stored
200 shown in FIG. 1. Referring to FIG. 2, the DSP 200 may image. The blur processing unit 203 may provide an intensity
 US 8,902,345 B2
7 8
selection menu of blur processing to the user. The blur pro captured image is a quick view image that is an image before
cessing unit 203 may process the sample image based on the being stored in the memory card (not shown).
selected blur processing intensity. The blur processing unit In operation 310, a second image is input and is displayed
203 may inform the user of a blur processing effect of the in the second region of the division frame. Here, the second
input image in advance. The blur processing unit 203 may image is an image to be synthesized with the first captured
perform blur process on the input image based on the selected image, which may be a live view image.
intensity. The effect applying unit 204 applies various image In operation 312, when the shutter-release signal is input,
processing effects to the input image. In addition, the effect the method proceeds to operation 314 where the second
applying unit 204 may provide an effect selection menu for image is captured. In operation 316, the second captured
selecting various image processing effects and may apply the 10 image is displayed. That is, the first captured image is dis
selected effect to the input image. played in the first region, and the second captured image is
The image synthesizing unit 205 may synthesize images, displayed in the second region. Here, before the second image
is displayed, an image, which is obtained by Synthesizing the
which are captured from each divided image of the division second image with the first image that is captured before the
frame, as one image. For example, the image synthesizing 15 second image, may also be displayed on the display Screen.
unit 205 may synthesize the images, which are captured from FIG. 4 is a flowchart illustrating an example of a method of
each divided image by using a horizontal-2-division frame, as controlling a digital photographing apparatus, according to
one image. another embodiment of the invention.
The display control unit 206 may display animage input by Referring to FIG. 4, in operation 400, a frame selection
the imaging device 115 or an image obtained after image menu for selecting one from among a plurality of division
processing is performed on the image input by the imaging frames is provided. In some embodiments, the frame selec
device 115, on the display unit 160, or may display an image tion menu may be a menu for selecting one from among
captured according to the shutter-release signal or an image horizontal-2-division, horizontal-3-division, vertical-2-divi
obtained after image processing is performed on the image Sion, and vertical-3-division and may be frames having vari
captured according to the shutter-release signal. 25 ous shapes and compositions.
The storage control unit 207 may store an image synthe In operation 402, when the division frame is selected, in
sized by the image synthesizing unit 205 in a memory card operation 404, the selected division frame is provided as a
(not shown), as one image file. division frame to a display screen.
In some embodiments of the invention, the display control In operation 402, when the division frame is not selected, in
unit 206 may display a first input image in a first region of a 30 operation 406, a default division frame is provided as a divi
set division frame, may capture the first input image accord sion frame to the display screen.
ing to a photographing signal, and may display the first input In operation 408, the first image is input and is displayed in
image in the first region. The display control unit 206 may a first region of the division frame.
display an input image, i.e., a live view image, in the first In operation 410, when there is a request for changing the
region of the division frame. When a first shutter-release 35 size of the division frame, in operation 412, the size of the
signal is input, the display control unit 206 may display a division frame is changed.
captured image obtained after the input image is captured by In operation 414, when the shutter-release signal is input,
the photographing control unit 202, or a quick view image in in operation 416, a first input image is captured. In operation
the first region. The display control unit 206 may display 418, the first captured input image is displayed in the first
another input image, i.e., another live view image, in a second 40 region of the division frame.
region of the division frame. When a second shutter-release In operation 420, a second image is input and is displayed
signal is input, the display control unit 206 may display in a second region of the division frame. In operation 422,
another captured image obtained after another input image is when the shutter-release signal is input, in operation 424, the
captured by the photographing control unit 202, or another second image is captured.
quick view image in the second region. Here, the captured 45 In operation 426, the first captured image and the second
image displayed in the first region and the captured image captured image are synthesized.
displayed in the second region may be images that are In operation 428, the synthesized image is displayed.
obtained after undergoing synthesis, or images before Syn In operation 430, the displayed, synthesized image is
thesis is performed. In addition, the photographing signal, stored as one image file in a memory card (not shown).
i.e., a first photographing signal or a second photographing 50 FIGS.5A through 5D are examples of views for explaining
signal refers to a signal generated when a half shutter S1 and an example method of controlling a digital photographing
a full shutter S2, or the full shutter S2 is pressed. apparatus, according to another embodiment of the invention.
FIG.3 is a flowchart illustrating an example of a method of Referring to FIG. 5A, a plurality of division frames 530
controlling a digital photographing apparatus, according to through 533 are displayed on a display screen, and a horizon
an embodiment of the invention. 55 tal-2-division frame 530 is selected from among the plurality
Referring to FIG. 3, in operation 300, the DSP 200 sets a of division frames 530 through 533. The bolded lines of
division frame configured by dividing a display Screen. In this horizontal-2-division frame indicate that it is selected. If one
embodiment, the division frame may include horizontal-2- is selected from among the plurality of division frames, a
division, horizontal-3-division, vertical-2-division, or verti frame selection menu may disappear from the display screen.
cal-3-division. 60 The display screen is divided based on the selected horizon
In operation 302, a first image is input and is displayed in a tal-2-division frame 530, and an input image 500 is displayed
first region of the division frame. The first image is a live view in a left region. Here, the input image 500 is a live view image.
image. A right region 510 may be a black screen before photograph
In operation 304, when a shutter-release signal is input, the ing. A user may perform an image capturing operation while
method proceeds to operation 306 where the first image is 65 seeing the input image 500 displayed in the left region.
captured. In operation 308, the first captured image is dis Referring to FIG. 5B, when a shutter-release button is
played in the first region. In some embodiments, the first pressed, a captured image 540 obtained by capturing the input
 US 8,902,345 B2
10
image 500 is displayed in the left region. Here, the captured the like, are displayed, and the blur 750 is selected and is set
image 540 may be a quick view image before the captured from an off state to an on State.
image 540 is stored. An input image 550 to be captured next As illustrated in FIG.7C, a menu for adjusting the intensity
is displayed in a right region. Here, the input image 550 is a of blur processing with respect to a boundary region 762
live view image to be captured so that the user synthesizes the between sample images 760 and 761 is displayed. If the menu
input image 550 with the captured image 540 displayed in the for adjusting the intensity of blur processing is selected, as
left region. The user may perform an operation of capturing illustrated in FIG.7D, the boundary region 762 is blurred. If
an image to be synthesized, while seeing the live view image OK is selected in FIG.7D, then the image of FIG. 7D may be
550 displayed in the right region. generated by the boundary region 762 of the division frame
Referring to FIG. 5C, a captured image 560 obtained by 10 being blurred with the set intensity of blur processing, and the
capturing the live view image 550 is displayed in the right image of FIG. 7D may be saved. The photographing appara
region. Here, the captured image 540 and the captured image tus may then display the input image illustrated in FIG.7E. If
560 may be synthesized images or images before being Syn a menu Cancel is selected in FIG. 7D, then the display screen
is returned to its previous state.
thesized. The user may determine whether to store the cap 15 FIGS. 8A through 8D are example views for explaining a
tured images 540 and 560 illustrated in FIG. 5C, i.e., quick method of controlling a digital photographing apparatus,
view images. When the captured images 540 and 560 of FIG. according to another embodiment of the invention.
5C are synthesized images, quick view images that are syn Referring to FIG. 8A, a plurality of division frames 810
thesized images may be stored as one image file in the through 813 is displayed on a display Screen, and a vertical
memory card (not shown), and when the captured images 540 2-division frame 810 is selected from among the plurality of
and 560 of FIG.5C are images before being synthesized, the division frames 810 through 813. An input image 800 is
captured images 540 and 560 of FIG. 5C may be quick view displayed in a left region, and a smart filter menu 810 is
images, respectively, and may be synthesized with each other selected. As illustrated in FIG. 8B, a plurality of image pro
according to user's election and then may be stored as one cessing effects, i.e., icons 1 through 5. Such as normal, ran
image file in the memory card (not shown). After the synthe 25 dom, miniature, vignetting, ink, and the like, are displayed.
sized image is stored, as illustrated in FIG. 5D, a plurality of The normal icon is grayed indicating that the input image 800
division frame selection menus is displayed, and a live view is currently normal with no effect. When icon 4 is selected and
image 570 is displayed in the left region based on the previ a menu OK is selected, as illustrated in FIG. 8C, the vignett
ously-selected division frame. ing effect is applied to the input image 800 to generate input
FIGS. 6A through 6C are example views for explaining a 30 image 801, which is displayed in FIG. 8D.
method of controlling a digital photographing apparatus, FIGS. 9A through9C are example views for explaining a
according to another embodiment of the invention. method of controlling a digital photographing apparatus.
Referring to FIG. 6A, a plurality of division frame selec according to another embodiment of the invention.
tion menus 630 through 633 is displayed, and a vertical-3- Referring to FIG.9A, a plurality of division frames 910
division frame 631 is selected, and a display screen is divided 35 through913 are displayed on a display screen, and a vertical
based on the selected vertical-3-division frame 631. An input 2-division frame 910 is selected from among the plurality of
image 600 is displayed in a left region, and a middle region division frames 910 through 913. An input image 900 is
610 and a right region 620 are black screens or in a state displayed in a left region, and a sample image menu 920 is
before photographing. selected. As illustrated in FIG. 9B, a sample image 930 is
When a user touches a boundary region 640 between the 40 displayed based on the selected vertical-2-division frame
left region and the middle region, as illustrated in FIG. 6B, 910, and a description of the sample image 930 is displayed.
identifiers that may adjust the size of the division frame are As illustrated in FIG. 9B, when a division frame 911 is
displayed. When the user drags from the boundary region 640 selected, a sample image 940 based on the division frame 911
to a right region 641, as illustrated in FIG. 6C, the left region is displayed, as illustrated in FIG.9C.
or the size of the division frame is increased, and the size of an 45 FIGS. 10 through 13 are example views of synthesized
input image 601 displayed in the left region is also increased. images, which are captured using each of the methods illus
In this case, as illustrated in FIG. 6B, when the size of the trated in FIGS. 3 through FIGS. 9A through9C.
division frame is adjusted, on screen display (OSD) icons that FIG. 10 illustrates an image that is obtained by synthesiz
were displayed on the display screen disappear. Here, when ing a first captured image 1000 and a second captured image
the user releases touch, as illustrated in FIG. 6C, the input 50 1010 with each other, and FIG. 11 illustrates an image that is
image 601 is displayed in the left region in the state where the obtained by synthesizing a first captured image 1100 and a
size of the division frame is increased, and the OSD icons that second captured image 1110 with each other, and FIG. 12
disappeared are re-displayed and are maintained in a photo illustrates an image that is obtained by synthesizing a first
graphing ready state. When a reset menu illustrated in FIG. captured image 1200 and a second captured image 1210, and
6C is selected, a previous division frame, i.e., the size of the 55 FIG. 13 illustrates an image that is obtained by synthesizing a
division frame is returned to its original state before the size first captured image 1300 and a second captured image 1310.
of the division frame is increased. As described above, in a digital photographing apparatus
FIGS. 7A through 7E are example views for explaining a and a method of controlling the same according to the one or
method of controlling a digital photographing apparatus, more embodiments of the invention, multi-division photo
according to another embodiment of the invention. 60 graphing is performed to allow a user to freely capture images
Referring to FIG. 7A, a plurality of division frames 730 and to synthesize several images with one image and to cause
through 733 are displayed on a display screen, and a vertical a selected effect so that improved experience and satisfaction
2-division frame 730 is selected from among the plurality of may be provided to the user.
division frames 730 through 733. An input image 700 is One or more embodiments of the invention provide a digi
displayed in a left region, and a menu is selected. 65 tal photographingapparatus that may provide improved expe
As illustrated in FIG. 7B, various photographing menus, rience and satisfaction to a user by performing multi-division
such as blur 750, a photo size 751, quality 752, flash 753, and photographing to allow the user to freely capture images, to
 US 8,902,345 B2
11 12
synthesize several images with one image, and to cause an and/or software components configured to perform the speci
arbitrary effect, and a method of controlling the digital pho fied functions. For example, the invention may employ vari
tographing apparatus. ous integrated circuit components, e.g., memory elements,
In some embodiments, the methods described herein may processing elements, logic elements, look-up tables, and the
be embodied in a computer readable medium that comprises like, which may carry out a variety of functions under the
computer code that when executed by a computer causes the control of one or more microprocessors or other control
computer to perform the methods described herein. The com devices. Similarly, where the elements of the invention are
puter readable medium may be non-transitory. implemented using software programming or software ele
The device described herein may comprise a processor, a ments the invention may be implemented with any program
memory for storing program data and executing it, a perma 10 ming or scripting language Such as C, C++, Java, assembler,
nent storage such as a disk drive, a communications port for or the like, with the various algorithms being implemented
handling communications with external devices, and user with any combination of data structures, objects, processes,
interface devices, including a display, keys, etc. When soft routines or other programming elements. Functional aspects
ware modules are involved, these software modules may be may be implemented in algorithms that execute on one or
stored as program instructions or computer readable codes 15 more processors. Furthermore, the invention could employ
executable on the processor on a computer-readable media any number of conventional techniques for electronics con
Such as read-only memory (ROM), random-access memory figuration, signal processing and/or control, data processing
(RAM), CD-ROMs, magnetic tapes, floppy disks, and optical and the like.
data storage devices. The computer readable recording The particular implementations shown and described
medium can also be distributed over network coupled com herein are illustrative examples of the invention and are not
puter systems so that the computer readable code is stored and intended to otherwise limit the scope of the invention in any
executed in a distributed fashion. This media can be read by way. For the sake of brevity, conventional electronics, control
the computer, stored in the memory, and executed by the systems, Software development and other functional aspects
processor. of the systems (and components of the individual operating
All references, including publications, patent applications, 25 components of the systems) may not be described in detail.
and patents, cited herein are hereby incorporated by reference Furthermore, the connecting lines, or connectors shown in the
to the same extent as if each reference were individually and various figures presented are intended to represent exemplary
specifically indicated to be incorporated by reference and functional relationships and/or physical or logical couplings
were set forth in its entirety herein. between the various elements. It should be noted that many
As the invention allows for various changes and numerous 30 alternative or additional functional relationships, physical
embodiments, particular embodiments will be illustrated in connections or logical connections may be present in a prac
the drawings and described in detail in the written descrip tical device. Moreover, no item or component is essential to
tion. However, this is not intended to limit the invention to the practice of the invention unless the element is specifically
particular modes of practice, and it is to be appreciated that all described as “essential' or “critical'.
changes, equivalents, and Substitutes that do not depart from 35 The use of the terms 'a' and “an and “the' and similar
the spirit and technical scope of the invention are encom referents in the context of describing the invention (especially
passed in the invention. In the description of the invention, in the context of the following claims) are to be construed to
certain detailed explanations of related art are omitted when it cover both the singular and the plural. Furthermore, recitation
is deemed that they may unnecessarily obscure the essence of of ranges of values herein are merely intended to serve as a
the invention. 40 shorthand method of referring individually to each separate
While such terms as “first.” “second, etc., may be used to value falling within the range, unless otherwise indicated
describe various components, such components must not be herein, and each separate value is incorporated into the speci
limited to the above terms. The above terms are used only to fication as if it were individually recited herein. Finally, the
distinguish one component from another. steps of all methods described herein can be performed in any
The terms used in the specification are merely used to 45 suitable order unless otherwise indicated herein or otherwise
describe particular embodiments, and are not intended to clearly contradicted by context. The use of any and all
limit the invention. An expression used in the singular encom examples, or exemplary language (e.g., “such as') provided
passes the expression of the plural, unless it has a clearly herein, is intended merely to better illuminate the invention
different meaning in the context. In the specification, it is to be and does not pose a limitation on the scope of the invention
understood that the terms such as “including or “having.” 50 unless otherwise claimed. Numerous modifications and adap
etc., are intended to indicate the existence of the features, tations will be readily apparent to those skilled in this art
numbers, steps, actions, components, parts, or combinations without departing from the spirit and scope of the invention.
thereof disclosed in the specification, and are not intended to
preclude the possibility that one or more other features, num What is claimed is:
bers, steps, actions, components, parts, or combinations 55 1. A method of controlling a digital photographing appa
thereof may exist or may be added. ratus, the method comprising:
For the purposes of promoting an understanding of the providing a menu of a plurality of division frames, each
principles of the invention, reference has been made to the division frame indicating the number of regions into
preferred embodiments illustrated in the drawings, and spe which a display screen is to be divided;
cific language has been used to describe these embodiments. 60 setting a division frame selected from the plurality of divi
However, no limitation of the scope of the invention is sion frames;
intended by this specific language, and the invention should displaying a first input image in a first region of the set
be construed to encompass all embodiments that would nor division frame;
mally occur to one of ordinary skill in the art. displaying in the first region the first input image captured
The invention may be described in terms of functional 65 according to a first photographing signal;
block components and various processing steps. Such func displaying a second input image in a second region of the
tional blocks may be realized by any number of hardware set division frame; and
 US 8,902,345 B2
13 14
displaying the second input image captured according to a displaying a second image in a second of the division frame
second photographing signal in the second region. and capturing the second input image according to a
2. The method of claim 1, further comprising: synthesizing Second photographing signal;
the first captured input image and the second captured input displaying the second captured input image in the second
image with each other and displaying the synthesized image. region; and
3. The method of claim 1, further comprising storing the storing a synthesized image obtained by Synthesizing the
synthesized image obtained by synthesizing the first captured first captured input image and the second captured input
image.
input image and the second captured input image as one 13. A digital photographing apparatus comprising:
image file. 10 a division frame setting unit configured to:
4. The method of claim 1, further comprising adjusting a provide a menu having a plurality of division frames,
size of the set division frame. each division frame indicating the number of regions
5. The method of claim 1, further comprising blur process into which a display screen is to be divided; and
ing a boundary region of the set division frame. set a division frame selected from the plurality of divi
6. The method of claim 1, further comprising: sion frames;
providing a selection menu for blur processing a boundary
15 a photographing control unit configured to control photo
graphing of an input image according to a photograph
region of the set division frame; ing signal; and
displaying sample images in the first region and the second a display control unit configured to: display the input
region, respectively, according to selection of the blur image and an image obtained by capturing the input
processing: image on the display screen, display a first input image
blur processing the boundary region based on the displayed in a first region of the set division frame, and configured
Sample images; and to display the first input image captured according to a
blur processing a boundary region between the first dis first photographing signal in the first region, display a
played input image or the second displayed input image. second input image in a second region of the set division
7. The method of claim 5, further comprising determining 25 frame, and display the second input image captured
an intensity of the blur processing. according to a second photographing signal in the Sec
8. The method of claim 1, further comprising displaying a ond region.
selection menu comprising a plurality of image processing 14. The digital photographing apparatus of claim 13, fur
effects on the first displayed input image and the second ther comprising an image synthesizing unit configured to
displayed input image. 30 synthesize the first captured input image and the second cap
9. The menu of claim 8, further comprising displaying the tured input image, and wherein the display control unit is
first input image or the second input image to which an image further configured to display the synthesized image.
processing effect selected using the selection menu is applied. 15. The digital photographing apparatus of claim 13,
10. The method of claim 1, further comprising: wherein the division frame setting unit is configured to adjust
displaying a sample image that is synthesized using the set 35 a size of the set division frame.
division frame. 16. The digital photographing apparatus of claim 13, fur
11. The method of claim 10, wherein information regard ther comprising a blur processing unit configured to blur
ing the synthesized sample image is displayed together with process a boundary region of the set division frame.
the synthesized sample image. 17. The digital photographing apparatus of claim 13, fur
12. A method of controlling a digital photographing appa 40 ther comprising a storage control unit configured to store the
ratus, the method comprising: synthesized image obtained by synthesizing the first captured
providing a menu of a plurality of division frames, each input image and the second captured input image together as
division frame indicating the number of regions into one image file.
which a display screen is to be divided; 18. The digital photographing apparatus of claim 13, fur
dividing a display Screen according to a division frame 45 ther comprising an effect applying unit configured to apply a
Selected from among the plurality of division frames; selected image processing effect, wherein the image process
displaying a first input image in a first region of the division ing effect is selected from a menu of a plurality of image
frame and capturing the first input image according to a processing effects displayed on the first displayed input
first photographing signal; image or the second displayed input image.
displaying the first captured input image in the first region; k k k k k