FranciscoSaez

Slay

Multiangle Video Reconstruction in 2D and 3D.

Slay. Every show, in your pocket.

Slay, Inc.
Founder
2020
Slay

Process

What If?

I was watching "Homecoming | A Film by Beyonce" somewhere in 2019 which is the recolection of Beyonce's performance at Coachella in 2018.
Nedless to say, this show is a masterpiece.

If you watch closely [Min 6:05 - Min 6:10], in a split second, the clothing of the whole band changes it color from Yellow to Pink, and got me thinking.

What?

VFX Right?

Wait, it is not just color, its different clothing to???? WTF is going on?!

Well, that concert was done over two separate weekends. One with one clothing style and one with another, bu it is so perfectly synced not only on video but audio and everything else that seems to be one continuous stream of video/audio.

It got me thinking... what if we could jump from one angle to another, staying in the same timeframe?

What if we could jump from different shows in different years, but staying on a continuous path of audio and video?

What if we could take all the videos recorded from a show to reconstruct the entire show without any video/audio loss?

What if we could re-create any live recorded show, not only in 2D but also in 3D so you can re-live this experience in the Metaverse?

The Idea

We needed to create system and method to reconstruct multiple videos from multiple perspectives of an event into a continuous stream of the event viewable from different angles considering:

  • The perspective sources may be received from different computing devices controlled by different parties.
  • The source streams needed to be parsed for metadata and content perspective.
  • The system should analyze different sources for an angle and rank the source streams based on quality and/or other metadata factors
People Recording/Streaming a Live Show
Multi-angle View Con

  • We'd rank the quality of the content and understand its position on the "main audio" track.
  • We'd need to combine al processed content to generate a final streaming output of the event which can be displayed from different angles.
  • This should be transmitted over Apps in 2D or as a continuous three-dimensional output based on the different angles of the source streams on VR.
Representation of 2D Reconstruction Process

I won't go further on the details because it is already public information on our Parsing and Processing Reconstruction of Multiangle Videos US Patent.

Prototypes

CONFIDENTIAL

Is Meta Sleeping?

This concept and method was originally pitched as an IG feature on my final presentation of  Product School, under the name "Instagram Shows".

Instagram Shows. Concept and Method by Francisco Sáez.
Suggested Name and "Logo"
Instagram Shows. Concept and Method by Francisco Sáez.
Suggested UI

I mean come on. hundreds of millions of stories shared every year...
More and more people doing "Lives" at shows...

It's just a matter of putting two and two together! They have the data, they have the rights, make this feature and get it right. (haha)

------

After releasing this idea on my blog few years ago, I was reached out by a recruiter from Instagram.
I had the weirdest, logest and most out of the norm interview process at Meta.

I've always wanted to work at Instagram, and since I came up with this Idea I dreamed of being on the  last interview and be able to pitch it...

"Let's say you're a PM at Instagram, in the music and entertainment division. What would you build?"
That was the last question of the final interview.

I delivered the entire pitch, step by step and there were no questions from the interviewer.

Next day I was informed that they had moved on with another candidate.

No feedback was received from recruiters after requesting.

Outcome

Work in progress. To be Released.

Patents:

More work