You might know motion capture as the tech that transformed Andy Serkis into Gollum, but now it can transform everyday people into animated avatars in virtual worlds, and all in real-time. Motion capture--which uses body sensors, ultra-precise cameras, and modeling software to create 3D animations from real-life human movement--is now taking on location-based virtual reality, or LBVR. PCWorld visited a leading motion capture company called Vicon in Oxford, England to learn how mocap has evolved to take on this new frontier in entertainment. If you've watched behind-the-scenes footage of how motion capture (or mocap) works, you've probably seen actors in skintight lycra suits covered with golf ball-sized sensors. Normally, dozens of infrared cameras track these sensors to model an actor's movements.
Modern motion-capture systems are the product of a century of tinkering, innovation and computational advances. Mocap was born a lifetime before Gollum hit the big screen in The Lord of the Rings, and ages before the Cold War, Vietnam War or World War II. It was 1915, in the midst of the First World War, when animator Max Fleischer developed a technique called rotoscoping and laid the foundation for today's cutting-edge mocap technology. Rotoscoping was a primitive and time-consuming process, but it was a necessary starting point for the industry. In the rotoscope method, animators stood at a glass-topped desk and traced over a projected live-action film frame-by-frame, copying actors' or animals' actions directly onto a hand-drawn world.
I don't really belong here, considering I barely know how to write some code. But I'm not sure where to look for help building a project where I am trying to utilize Human Pose Estimation and/or skeleton tracking. I've got some funding to pay somebody who is interested in helping, now I just don't know where to find that person, so I thought I'd look here.
If you ever played the OG Mortal Kombat, you have to see the original motion-capture of actors whose movements and likeness would be the inspiration for one of the greatest gaming franchises of all-time. Imgur user RambleKhron compiled the videos, turning sections of them into gifs with a short description and a link to the video it came from. Below are those choice gifs made by RambleKhron. It's no secret to fans of the original game that motion capture was used for playable fighters. It gave the game its gritty feel, and made the violence more realistic and dangerous at a time when video game violence was seriously under attack by both the media and governments worldwide.
See the included notebook for a detailed explanation and implementation. The model is implemented in Keras/Tensoflow, and is trained on data from 22 3d movies, sampled at 1 fps. Validation is perfomred on 3 held out movies. The total number of stereo frame is about 125K, training took 4 days on a gtx 1070 with batches of 6 stereo images with resolution 192x336 per eye.
One of the best-kept secrets of 2016 was the fact that a major character in Gareth Edwards' "Rogue One: A Star Wars Story" would be appearing on screen for the first time since the actor who portrayed him passed away over 20 years ago. Through visual effects wizardry and a live-action performance by actor Guy Henry, the commander of the first Death Star in 1977's "Star Wars," Grand Moff Tarkin, was brought back to the big screen as though the late Peter Cushing was still portraying him. For John Knoll, it was the most difficult aspect of his responsibilities as visual effects supervisor on the global blockbuster. An Oscar winner for his work on "Pirates of the Caribbean – Dead Man's Chest," Knoll believes the illusion wouldn't have succeeded without Henry's presence. The effects team's job was effectively that of someone who would be creating cosmetic or prosthetic makeup.
Disney has ended a deal with PewDiePie - the world's highest earning YouTube star - after he posted allegedly anti-Semitic videos online. Felix Kjellberg posted at least nine offensive videos to his channel in six months, including one that featured two Indian men paid to hold up a sign reading "Death to All Jews". The 27-year-old Swede has more than 53 million subscribers to his channel and his videos - which mostly feature him playing computer games - have been watched over 14 billion times, more than anyone else's on the site. In 2016 he earned $15 million from advertising, sponsorships, appearance fees and merchandise. Part of his business was a joint venture with Disney's Maker studios, agreed in 2014.
Sometimes all you need is Katy Perry, a hamster and some tiny doll-size food. And that's precisely what you get in her just-dropped video for new song "Chained To The Rhythm," ft. It's her first song since the release of Olympic anthem "Rise" in summer 2016 and, naturally, we couldn't be more excited. The song features Bob Marley's grandson Skip, and was written by Perry, Sia and producer Max Martin. The song's mid-tempo beat lends a note of reggae to Perry's usual synth-pop.
Apple has purchased the company behind motion-capture technology used in the latest Star Wars film. Faceshift, a Zurich based start-up, specialises in software that allows 3D animated characters to mimic the facial expressions of an actor. Apple has now bought the company, though it is not known how much the deal cost the tech giant. It is also unclear what Apple's plans are for the company following its acquisition. A spokesman said: "Apple buys smaller technology companies from time to time, and we generally do not discuss our purpose or plans."