The Rt. Rev. V. Gene Robinson of New Hampshire, who was elected the Episcopal Church’s first openly gay bishop in 2003, will deliver the invocation for Sunday’s kickoff inaugural event on the steps of the Lincoln Memorial, the Presidential Inaugural Committee said.

President-elect Obama is scheduled to attend the afternoon event, which is free and open to the public...