Skip to content

Clean up "equivalence" of penalty and constraint form regularization #78

@davidrosenberg

Description

@davidrosenberg

There's something going on that needs clarification.
Suppose w^* is an unconstrained minimizer of phi(w), and suppose Omega(w^*)=R.
Say phi(w) is a quadratic objective for a linear system that has a null space. Then there's another minimizer w^** that has Omega(w^)=r>R.
So w^
is a solution to a constrained optimization problem, but not of the penalized form. What assumption is not met in the equivalence theorem from the homework?

Even if w^** is not attained as a solution to a penalty form problem, say something about the corresponding linear function being attained?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions