51 views

Uploaded by JeremyWang

CS

- FEM and Quantum Mechanics
- If Em
- raghavan.pdf
- Chap3Examples.pdf
- VI Sem. B.sc. Mathematics - Core Course - Number Theory and Linear Algebra
- State-Space Formulation for Structural Dynamics by Jose Luis Mendoza Zabala
- pg625-26
- Markov Chain
- lec6
- Lenguaje Ensamblador Irvine 5a Edición
- HW4Sol
- V 31132139
- mth401
- Book1, Chapter 6: matrix, Author: N.D. ingham. Pheniox publications.
- Normalization Cross Correlation Value Of
- FactorAnalysisTutorial
- Final Exam With Results
- OutageProb_MISO
- Lecture 6
- Symmetry

You are on page 1of 2

Exam

(Spring 2017)

Note This quiz is for self-examination. It is far more valuable to you if you refrain from web

searching answers --- using Wikipedia to look up important concepts (click-able pointers in red

color) is fine. You do not have to finish all questions. Necessary mathematical topics would be

discussed, albeit briefly, in lectures. The orders/points of questions do not always imply

difficulties.

Solutions are due in the second class.

Convexity

The following questions test your basic skills in computing the derivatives of univariate

functions, as well as applying the concept of convexity to determine the properties of the

functions.

1. (1 pt) Show that f (x) = x

2

and g(x) = ln x are convex and concave, respectively.

2. (2 pts) Show that is neither convex or concave (feel free to plot the function

1

h(x) = −x

1+e

3. (2 pts) Show that − ln h(x) is convex.

1. (2 pts) Prove that x − 1 ≥ ln x for ∀x > 0. (Hint: Show the minimum of x − 1 − ln x is 0

by studying the function's monototicity.)

2. (3 pts) Using the above property to show that, for any probability vectors p = (p1 , ⋯ pK )

and q = (q1 , ⋯ qK ),

K

pk

K L(p∥q) = ∑ pk ln ≥ 0,

qk

k=1

where K L(p∥q) is called the Kullback-Leibler divergence between p and q . Note that for

probability vectors, pk ≥ 0 and qk ≥ 0 and additionally, ∑k pk = 1 and ∑k qk = 1,

3. (3 pts) Using the above property to show that, for any probability vector p = (p1 , ⋯ pK ),

H (p) = − ∑ pk ln pk ≤ ln K

k=1

Optimization

The following questions test your familiarity with the method of Lagrange multiplier.

1. (2 pts) Consider the following two functions

2 2

f1 (x, y) = (x − 1) + (y − 1)

2 2

f2 (x, y) = (x − 3) + (y − 2)

2

+ y

2

≤ 1? Please show the derivation steps.

2. (5 pts) In a R (i.e., D-dimensional Euclidean space), what is the shortest distance from a

D

D

terms of w, b and x0 . (Hint: Please show the detailed derivation steps. Formulate this

problem as a constrained optimization and then use the method of Lagrange multiplier.)

1. (3 pts) Consider a random variable X that follows the uniform distribution between 0 and a.

Please calculate the mean, variance and entropy of X. Please show the steps of the

calculation (you can look up results on the web to verify your calculation.)

2. (7 pts) Suppose we have observed N independent random samples of X, (x1 , x2 , ⋯ , xN ).

What is the maximum likelihood estimation of a? Please show the derivation steps. Is this

estimate unbiased? Please justify your answer too.

3. (6 pts) Given two independent Gaussian random variables U ∼ N (−1, 1) and

V ∼ N (1, 1), are the following random variables also Gaussian? If so, what are their

U + V U with 50% chance

Y = U + V, Z = U × V, T = ( ), W = {

U − 2V V with 50% chance

4. (5 pts) We have two coins: one is a fair coin -- observing either the head side or the tail

side with 50% probability. The other coin is a fake coin which has head on both sides.

Suppose we randomly pick one and toss it (the two coins are otherwise the same so either

one would be picked up with a 50% probability). (Hint: Use the rules of probability and

Bayes's rule).

What is the probability we observe head?

If we indeed observe head, what is the probability we had picked the fake coin?

Linear algebra

1. (4 pts) Consider the covariance matrix Σ of a random vector X , which is

Σ = E[(X − EX)(X − EX) ], where EX is the expectation of X . Prove that is

⊤

Σ

positive-semidefinite.

2. (5 pts) Let A and B be two RD×D symmetric matrices. Suppose A and B have the exact

same set of eigenvectors u1 , u2 , ⋯ , uD with the corresponding eigenvalues α1 , α2 , ⋯ , αD

for A , and β1 , β2 , ⋯ , βD for B . Please write down the eigenvectors and their

corresponding eigenvalues for the following matrices

C = A + B, D = A − B, E = AB, F = A (assume is invertible)

−1

B A

A 0

, where is the all-zero matrix.

2D×2D D×D

G = ( ) ∈ R 0 ∈ R

0 B

- FEM and Quantum MechanicsUploaded bygrvmaurya999
- If EmUploaded byapi-3700440
- raghavan.pdfUploaded byYasser Naguib
- Chap3Examples.pdfUploaded byMikel Lopez
- VI Sem. B.sc. Mathematics - Core Course - Number Theory and Linear AlgebraUploaded byMohan Rao
- State-Space Formulation for Structural Dynamics by Jose Luis Mendoza ZabalaUploaded byC V CHANDRASHEKARA
- pg625-26Uploaded byLeonard Gonzalo Saavedra Astopilco
- Markov ChainUploaded byAmitava Manna
- lec6Uploaded byHenrique Mariano Amaral
- Lenguaje Ensamblador Irvine 5a EdiciónUploaded byClaudio Guaita
- HW4SolUploaded byshbaraye2
- V 31132139Uploaded byAnonymous 7VPPkWS8O
- mth401Uploaded byhumza8081
- Book1, Chapter 6: matrix, Author: N.D. ingham. Pheniox publications.Uploaded byAbhijit Kirpan
- Normalization Cross Correlation Value OfUploaded byInternational Journal of Research in Engineering and Technology
- FactorAnalysisTutorialUploaded byparikhjinal
- Final Exam With ResultsUploaded byБатсүх Отгонцэцэг
- OutageProb_MISOUploaded bync02sdim
- Lecture 6Uploaded byRyan Gilbert
- SymmetryUploaded bysevkax
- EigenValue.pdfUploaded byPrithwish Saha
- Dynamic Facrte RecognitionUploaded byC Pratap Singh
- 2blockPLS RohlfCorti-Uploaded byattilal_5
- Chapter 14 notesUploaded byklerinet
- Fibonacci Module PrimeUploaded byYoung Hegelian
- Graphs ChapterUploaded byDanBrickley
- An Introduction to ObserversUploaded byapi-3826450
- NarayananUploaded byjuan
- MTK3002_Notes for StudentUploaded byLela Mahali
- Intrinsic and ExtrinsicUploaded byZaid Alavi

- Linux Examples SlidesUploaded byJeremyWang
- Introduction to BioHPC Lab v4Uploaded byJeremyWang
- Mother 3 - Sad ThemeUploaded byJeremyWang
- 02 Gates NotesUploaded byJeremyWang
- Linux Examples ExercisesUploaded byJeremyWang
- beginners_python_cheat_sheet_pcc_all.pdfUploaded byAlbert Stefan
- Prelim 2 SP14Uploaded byJeremyWang
- Proof by DotsUploaded byJeremyWang
- Hybrid Busses for TCATUploaded byJeremyWang
- Zaslaw on Mozart's Piano ConcertosUploaded byJeremyWang
- Beginners Python Cheat Sheet Pcc AllUploaded byJeremyWang
- NJCL Greek Derivatives TestUploaded byJeremyWang
- Silver 1 SolUploaded byJeremyWang
- Adagio Quasi FantasiaUploaded byJeremyWang
- AP Physics 1 2 Course and Exam DescriptionUploaded byHorizonAcademy
- AbolitionismUploaded byJeremyWang
- AgainUploaded byJeremyWang
- 2017FA BrochureUploaded byJeremyWang
- 2004 2010 NJCL Latin and Greek Derivatives ExamsUploaded byJeremyWang
- 1-17 Microbe MissionUploaded byJeremyWang
- Silver 1Uploaded byJeremyWang
- IMSLP66589-PMLP134976-sicilienneUploaded bycmadarro
- 2016 Freshman BrochureUploaded byJeremyWang

- Model Curriculum Diploma ChemicaUploaded byTutikaChandu
- GL Ship VibrationUploaded byphuocthontu
- applied_mathsUploaded byVinay Mishra
- Whitened Channel EstimationUploaded byYasser Naguib
- _sparse Linear Solver Paralelo (Nao GPU)Uploaded byLucas Pantuza
- Gröbner Bases, Gaussian Elimination and Resolution of Systems of Algebraic EquationsUploaded byAnonymous Tph9x741
- Equivalent Static LoadUploaded byDasaka Brahmendra
- SevenUploaded byMarin Spaić
- Linear Algebra notesUploaded byalijazizaib
- LP ProblemsUploaded byCristian Antonio Vega Ortiz
- M.sc. MathemeticsUploaded byŠtŸløžx Prıı'nc Aadi
- TSP50RMUploaded byapi-3828195
- Uncertainty-Measurement-Procedure.pdfUploaded byediwski
- Staff Selection Commision RadsUploaded byarit
- Principal Component AnalysisUploaded byNovi Nurcahyaningsih
- Transfer Function State Space Representation RLC Circuit Example 2Uploaded byLatif Kebbabi
- Jerasure: A Library in C Facilitating Erasure Coding for Storage ApplicationsUploaded byherrwiese
- Functional and Structural Tensor Analysis for EngineersUploaded byManuel F. Presnilla
- ArraysUploaded bypankajusb
- Mres Stat a Notes Jan 2009 Part AUploaded byBrian Rogers
- 2013 Regulation ME Structural EngineeringUploaded bymahendranmahe
- Lecture2 HandUploaded byNicholas Foster
- Study and Analysis of Single Point Cutting Tool Under Variable Rake AngleUploaded byIJRASETPublications
- syllabus_I_DEE_R-13Uploaded byRajesh Prasad
- User ManualUploaded byAntalcides Olivo
- Rouths ArrayUploaded byFrancis5801
- EquationUploaded byJasper Cacbay
- Number TheoryUploaded byELOK YULIA FAIKOH
- SolidWorks Simulation - Avoiding SingularitiesUploaded byAnonymous P8Bt46mk5I
- Tut 10ab Sem2 1011Uploaded byFeeling_so_fly