Skip to content(if available)orjump to list(if available)

How Tesla is proving doubters right on why its robotaxi service cannot scale

general1726

Of course it can't scale. Putting 10000 cars with 1 human in them into a city is hard and just creates traffic. Putting 100 buses with 100 people in them is much easier.

Also why don't you use something what has less degrees of freedom like a train and thus is much easier to automate and also much easier to scale by just connecting more cars. You got that Loop thing, expand onto it and turn it into a subway...

Elon is trying to reinvent public transportation without a shred of understanding why did we get into current state - buses, subways, trams. There is natural development behind it, it is not like somebody said that city people shall only sit next to a stranger - you literally can't fit these cars in the city if you want to transport people to work and from work every day. There is no physical capacity for that. Unless you will use existing mass transportation solutions.

whynotmaybe

> Elon is trying to reinvent public transportation without a shred of understanding why did we get into current state

No, Elon wants to cancel public transportation. Just like in the 1930's when car companies bought public transportation to shut them down.

He already delayed public transportation work with his Boring company.

The average people won't agree to spend money on public transportation when there are robotaxi available 24/7 on "already existing infrastructure".

rayiner

> The average people won't agree to spend money on public transportation when there are robotaxi available 24/7 on "already existing infrastructure".

90% of people hate public transportation. They want to be in a private cabin that takes you directly to where you’re going.

There’s nothing you can do about it other than to impoverish the population. I have lots of immigrant family that move to NYC because that’s where our ethnic enclave is. They uniformly strive to move somewhere suburban where everyone can have their own car. My cousin just moved her family with three kids to Arlington Texas from Queens and is thrilled.

Elon is trying to address the problem people actually have instead of the one some minority thinks we should be solving.

rsynnott

A good public transport system can be faster than driving, tho. Really take any city with a large metro system. And driving in such a city only works as well as it does because most people use the metro system. Move everyone to cars, and it grinds to a halt.

elromulous

Literally the plot of Who Framed Roger Rabbit.

Zacharias030

Can you point to an article about the 1930s? This is interesting.

null

[deleted]

interestica

> Elon is trying to reinvent public transportation

If done well, this should fix the most critical gap in public transit. You can move massive amounts of people via trains and buses -- but that doesn't get them from transit to home (unless you're lucky enough to live near an access point).

The robotaxis should be solely used for that 'last mile' -- reduce the need for transit parking (which is insane for commuter lots).

oersted

I agree with your take on public transport, but I don't understand your point.

Tesla's robotaxis are not trying to replace public transport, they are trying to replace taxis, and eventually private cars. Uber made taxis more accessible and it scaled plenty, perhaps Tesla can do the same thing, in principle, with another degree of accessibility and cost-effectiveness. If anything, they may reduce the number of cars on the streets if more of them are shared.

I haven't yet formed a strong opinion on the viability of their vision, but that's beside the point.

Public transport is the last thing they will replace, and it is to a large degree complementary just like it has been for the last century. Public transport is of course far more efficient if you are willing to sacrifice a bit of immediacy and, well, interacting with the public. For the rest there's the private transport option, with various degrees of who drives and how much you own the car, that's where Tesla is aiming.

detourdog

The scaling problem is the Robotaxi implementation details. Waymo is scalable in the way you describe. Tesla’s Robotaxi current restrictions make is what is holding back scalability.

zhoujianfu

Also, I realized a side effect of a hypothetical world where everybody rode in robotaxis/waymos/even ubers is we’d effectively get congestion pricing everywhere (due to “surge” pricing), and the use of roads would actually fit into regular supply and demand market forces!

dougSF70

Also, when I am not driving my car I park it, it is not adding to congestion. Waymo Taxis roam the streets in SF adding to congestion. I cant see how congestion can be reduced...the worst congestion happens during rush hour...replacing personal cars with a Waymo will have no effect.

hammock

Why take a plane to Europe with 300 pax when you can take an oceanliner with 7000 pax , fewer degrees of freedom, more energy efficient and use ports and harbors that have existed for 1000s of years rather than building new runways and introduce noise pollution?

oersted

Indeed, individuals optimise for latency not throughput. They may be willing to go for high-throughput low-latency options if the cost-savings are significant, but that is often not the case.

johnfn

Have you used busses or the metro recently? My girlfriend refuses to ride them because they are dirty, uncomfortable, and most crucially, unsafe. And although I am an ardent supporter of public transportation, I tend to understand her side quite well when I see fare hoppers, people blasting loud music, shouting incoherently or doing drugs - and I probably see one of those every time I ride.

I use public transportation frequently. But I feel that 50 years of work on public transportation has created a system that fails a large percentage of the population. Perhaps another solution is needed.

TrackerFF

I live in northern Europe now. The only time I ever felt unsafe on a bus, was once when a raving junkie walked up and down the bus with a scissor in his hand, trying to "sniff out the snitch". Turns out the bus I took, was the bus that also went to a halfway home.

But that's about it. I've taken thousands of rides, and have felt safe.

Sure, there are some annoying aspects - like teens blasting music, drunk people going out on the weekends, but most of the time it is pretty good.

Then again, taking the bus isn't looked down on in Europe - and carries no shame , so to speak. That goes for the metro, too.

oersted

Sure but this is not a fundamental issue with public transport, it's an issue with the implementation of public transport in the US. There are plenty of places where it's done well, and it is felt deeply.

Living in major city in the Netherlands I have never felt any need to own a car. I've been quite open to it a few times and I can afford it no problem, but it was just not worth the hassle, it's just an inferior option.

andoando

How about just fix those problems in public transport. Weve put zero thought/resources into it

simgt

> I see fare hoppers, people blasting loud music, shouting incoherently or doing drugs - and I probably see one of those every time I ride

It has very little to do with public transports and everything to do with our declining western societies. I've never witnessed any of these in any part of developed Asia I know of...

> Perhaps another solution is needed.

Reducing inequalities, funding education, local police, etc. all seem like a more sustainable way forward than shielding ourselves from the shit in a robotaxi...

seanmcdirmid

Just enforcing basic laws and rules on buses would go a far way. Also fare enforcement is talked about in Seattle not as a way to raise more revenue for the system (indeed, fare enforcement costs more than it brings in), but to make it safer (no one wants to ride Link and get stabbed at Capitol Hill station).

almosthere

Make crime crime again and get rid of the loud music and drug use?

As a society we forgot how to just stand up and say no. We relegated people doing so as Karens instead of supporting them.

general1726

That sounds like a self centered culture problem not a public transportation problem.

mafuy

For what it's worth, I prefer drugged up people in a bus rather than behind the wheel. It's better to be annoyed by them than to be dead from a car crash with them.

apparent

This seems like a false dichotomy. In general, the drugged up people on the bus probably don't have cars.

fwip

Using public transport is, statistically, safer than a private vehicle.

It is often perceived as unsafe, but perception is not reality.

__alexs

None of those things particularly contribute to the traffic problem.

If the problem you are trying to solve is "interacting with random humans" then sure Robotaxi is good. If you are interested in "moving a lot of people to where they need to go efficiently" then it's not.

baron816

I hope at some point, ride hailing companies will start offering something like a bus service. The trick will be normalizing prescheduling trips. Like, if I schedule a vehicle to pick me up at 8:15am to drive me to the office Tuesday, Wednesday, Thursday, and a return trip at 5:30, you'd be able to better optimize picking up more people on the way who are going to a similar location and to do so in an appropriately sized vehicle. That would bring down prices a whole lot, while mitigating congestion.

I'd be willing to pay a bit more vs a bus if it means I can have a reliable pickup time, a guaranteed seat, and I feel safe.

triceratops

> you literally can't fit these cars in the city if you want to transport people to work and from work every day. There is no physical capacity for that

There's no space for 4-seater sedans each carrying a single person. How about tiny 1-seater self-driving golf carts going no more than 30mph? They take up as much space as 2 bus seats. This is ok because you're saving the space from the bus's aisle and driver compartment, and because buses rarely run completely full so they already waste some space.

These vehicles don't exist today. But I bet you could design and build them much cheaper than subway systems in most North American cities. These cities tend to be less dense than European or Asian cities, where trams and subways are more economical.

general1726

Well then you will find out that these vehicles needs their own infrastructure, because they don't exist in a vacuum, but in a city where lot of other elements are using the roads, like people crossing streets on lights.

And when you will get your own infrastructure, well you are converging back to a subway or overhead light railway.

alexisread

No you don't have to converge to that. Railways and trams tend to be defined by track switching. In-car switching creates a different class of system as the track is dumb, headways can be much tighter, and with a network of rails you don't have to go to a central hub, to go to another central hub, to then go to where you actually want to go.

Stations can be frequent and offline, individual transports can be smaller to transport a family / sleeper car / pallette-load of goods, land use under the track becomes available ie. new routes over farmland become viable, tracks can cross easily in 3D, and can as they are prefabbed, a line can be constructed and repaired quickly.

Although it's (IMHO) not ideal, https://openprtspecs.blogspot.com/2011/11/climbing-chain.htm... can give you an idea of the possibilities.

triceratops

> you will find out that these vehicles needs their own infrastructure, because... people [cross] streets on lights.

Isn't handling that part of the definition of "self-driving"?

appreciatorBus

Most of the land consumed by vehicle operation is not consumed by the vehicle itself, but by the headway in front of the vehicle that’s necessary for safe operation at a given velocity.

For instance, at 0 mph, car might be 20 feet long and occupy a 10 foot wide lane, for a total land consumption of 200 ft². However, at 60 mph using the two second rule for safe following distance it needs an extra 240 feet of distance for a total land consumption of 2600 ft.².

By limiting your one seat golf carts to 30 mph, you’ll certainly need less headway then something people expect to operate at 60 or 70 mph, but it will still be much larger footprint than simply the vehicle itself.

Of course, this is true of other vehicles, including buses and trains, but they get to divide that land consumption by the number of people inside, making the comparison much more favourable.

IMO Better than arguing about what type of vehicles people should and shouldn’t use, we should simply stop giving away public land for vehicles as if it’s free. Require the public, as owners of the land, be reimbursed for land consumed by private vehicles, including headway. If you’re Elon Musk and you’re terrified of strangers on transit, that’s fine. You just have to reimburse the public for the extra land required to travel alone in your robot car.

triceratops

I'm not opposed to congestion pricing. I think it is inevitable as self-driving technology becomes widespread. Robodrivers remove the pain of being stuck in traffic. So you need something else to prevent forever traffic jams.

> buses and trains, but they get to divide that land consumption by the number of people inside, making the comparison much more favourable

Buses and trains rarely run completely full. A one-seater golf cart is a "bus" that runs at 100% occupancy.

tossandthrow

Regardless, you'd need to get Americans out of their huge SUVs.

Whether it is into golf carts or trains, I bet you there will be resistence.

Grimblewald

"this is ok because..."

you might want to think a bit longer on the inefficiencies here.

triceratops

Do tell...

I see half-empty city buses running all the time and no one says boo about "inefficiencies" then. And even then city buses outside of dense metros run no more frequently than every 15 minutes, but only during rush hour, and only on popular routes. That's no way to get everyone loving public transport.

I want to take public transport. I don't want to spend hours waiting for the bus. I don't want to wait 20 years for a subway to be built either. What do I do?

The only answer is more frequent, smaller buses. But drivers are expensive. So then self-driving buses. And if the buses drive themselves, you really want to them to be completely full, all the time. What kind of "bus" is always completely full? A single-seater golf cart.

WalterBright

> Elon is trying to reinvent public transportation without a shred of understanding

Given Elon's enviable track record of proving the doubters wrong, I'd be hesitant to make such a claim.

darkhorse222

That's an appeal to authority. Either make an argument for why his reasoning is good or don't. But don't appeal to someone's reputation.

That being said, I do think what the parent commenter is missing is that those other modes require significant investment. With cars you get profit and can scale one by one. So less up front investment. Should do nicely in all sorts of cities.

WalterBright

An appeal to authority is a logical fallacy, unless the authority is an expert in a relevant field.

Elon is an expert at overturning conventional wisdom of what can be done in high risk enterprises. And transportation is one of his enterprises.

Disposal8433

The lies about FSD, the webcams instead of Lidars, the fake robot controlled by a human being, the obsession with shitcoins, firing useful people, the lies about his subway thingy, or being a literal Nazi in front of the cameras?

I'm wondering what track record you could talk about, because I believe this guy should be in jail forever but you will surely prove me wrong.

leptons

Please list some of the things he's "proved the doubters wrong" about.

breadwinner

Having taken Waymo rides multiple times in San Francisco I can attest to how awesome Waymo is. I am worried Tesla will bring a bad name to the whole robotaxi industry. Waymo has never had an at-fault injury accident. Tesla FSD has killed many people.

tzs

In the US it is officially 2 deaths involving Teslas with FSD engaged, with a couple more under investigation but not yet verified that FSD was engaged.

Still way more (no pun intended!) than Waymo, which has had 1 Waymo involved in a 6 car crash that killed someone in one of the other cars. Besides the human fatality a dog was also killed, and 5 other people were injured, some seriously. The Waymo was empty at the time.

Ironically this crash was due to a Tesla.

The Waymo and the other cars were all waiting at a red light when the Tesla rear ended them at 98 mph.

The driver of the Tesla was not impaired at the time of the crash. He says he tried to stop but the brakes were not responding.

The driver was from Hawaii, and it was later discovered that there is someone in Hawaii with the same full name, Jia Lin Zheng, with a record of around 20 traffic crimes over the last 20 years, including excessive speeding and running red lights.

I don't know if it had been determined if the Jia Lin Zheng visiting from Hawaii who caused the San Francisco crash is the same Jia Lin Zheng as the Hawaiian Jia Lin Zheng who has the long record of unsafe driving.

I'm not familiar with the naming conventions of whatever country/culture that name comes from. Is Jia Lin Zheng the kind of name that probably many people have in Hawaii or is it one that is likely rare?

aqme28

> In the US it is officially 2 deaths involving Teslas with FSD engaged, with a couple more under investigation but not yet verified that FSD was engaged.

That is not a useful metric for Tesla. They disengage FSD when they detect a potential accident.

ACCount36

Bullshit. And I am tired of having to call people out on it.

Autopilot shuts down when it can't handle the situation it's in. This doesn't help it "avoid blame" at all. Because Tesla considers Autopilot implicated in any crash that happened within 5 seconds from Autopilot being disengaged.

> To ensure our statistics are conservative, we count any crash in which Autopilot was deactivated within 5 seconds before impact, and we count all crashes in which the incident alert indicated an airbag or other active restraint deployed.

NHSTA's reporting requirements are even more conservative:

> Level 2 ADAS: Entities named in the General Order must report a crash if Level 2 ADAS was in use at any time within 30 seconds of the crash and the crash involved a vulnerable road user being struck or resulted in a fatality, an air bag deployment, or any individual being transported to a hospital for medical treatment.

darknavi

Well that, and most of the incidents I've seen haven't been using FSD but instead traditional Autopilot which hasn't received updates in years.

Kerbonut

It’s still counted as FSD enabled. Would you prefer FSD to remain active and potentially cause further collateral damage after an accident causing who knows what kind of damage to the vehicle? Safer to shut it down when systems are working and brace for impact. Seriously use your brain.

maxlin

Your argument is ridiculous. Might as well attribute all accidents with any Tesla close in vicinity to FSD then?

The data is collected in all of these incidents, and most people have seen the clips of FSD avoiding otherwise potentially lethal accidents, so "They disengage FSD when they detect a potential accident" is also just patently untrue.

prng2021

Tesla’s disengage their self driving just before a crash. That’s how the company can say FSD hardly ever causes crashes.

Kerbonut

Wrong. They disable it because it’s a safety thing. They still count it towards their metrics that FSD was enabled.

kindkang2024

As for 'Jia Lin Zheng'—it's a typical Chinese name. I can confirm that, as I am Chinese myself.

null

[deleted]

renewiltord

Zheng Jia Lin is a common name. And there are many Chinese/Taiwanese in Hawaii. Source: wife’s family is Taiwanese.

I remember this incident. It happened a couple of blocks away. Unreasonable that they let him go.

sMarsIntruder

How many people saved by the tech?

sorcerer-mar

Tesla doesn't release the data required to assess this.

And from that information alone, you can get the gist of what that data says!

(inb4 you post the accidents per mile chart which is very obviously useless and designed to mislead midwits, as it is not controlled for age of automobile or driving conditions)

jeffbee

Probably none. Fatalities in Teslas grossly exceed those in comparably-priced vehicles, which is the only benchmark that matters. Unless your counterfactual is that Tesla would be even more dangerous without FSD, but I don't think that is a useful counterfactual.

tsimionescu

The good news so far is that Tesla doesn't have a robotaxi service at all, they have a plain taxi service. We'll see what happens if they ever release a self-driving car, but for now, as in the past 7-8 years, they are way behind Waymo in the self driving car arena.

hansvm

Waymo came close with me. There were two left turn lanes, and it migrated from the inner one to the outer one in the middle of the turn without a blinker while I was next to it. It got lucky that I'm young and wasn't too tired and also that it was a relatively safe place to run me off the road.

Marsymars

This is tough for people to get right too. Near my house we’ve got 2 left turn lanes that merge into a 3 lane road without any lane markers, and I’ve got to maintain constant vigilance for people drifting into my lane.

maxlin

With that logic might as well do away with all defensive armies because they've "killed so many people". Firefighters too.

FYI. FSD is safer than human drivers on large datasets. Accidents cause deaths of thousands every year. Arguing against FSD for "safety" has The Grim Reaper cackling.

renewiltord

It’s that Waymo is both more widespread and better. If there were no Waymo, then sure. But there is Waymo.

Joel_Mckay

Camera based guidance systems are unreliable, and the number of edge-case failure modes grow exponential in time.

LIDAR/LADAR based systems are not perfect, but do offer mm precision for guidance systems. SLAM based LIDAR systems can be very good, but are also not perfect when forced to guess where a platform is located.

Cheers, =3

maxlin

Human bicameral driven cars are unreliable too, but FSD is more reliable. And more reliable, with way more data than any competing technologies.

Using vision for driving is something that has worked for as long as cars have existed. Trying to push some "millimeter precision" solution with unproven feature set and prohibitive hardware accessibility is just asking for no real safety improvements and just more lives lost.

Cheers.

Bluestein

> edge-case failure modes grow exponential in time.

How so? Honestly asking.-

rightbyte

Failures in automotive programs are surely linear to time over a year with all seasons.

Joel_Mckay

That is a long explanation, but generally even human binocular disparity incorrectly guesses 3D structures and distances. Our brains automatically fill in a lot of missing information that computers just can't know a priori (example: you know a dog hidden behind a car doesn't actually vanish nor remain stationary.)

Most guidance platforms would use LIDAR/SLAM to describe the local road surface, and overlap camera vision data to extrapolate distant surfaces and objects. Note distant objects also have lower resolution, unknown non-distinctive features (speed bump, or open man-hole cover etc.), and increasing sparse data as velocity effectively lowers world-state sampling rates.

The world-state is constantly changing at every intersection, sampling constraints add latency, and the navigation way-point goals may reach contradiction with immediate path-planning due to ambiguous/expired information.

Cheers =3

samrus

the thing about waymo is that i suspect they're running the same ML fraud that tesla itself is running in the silicon valley in general, which is to overfit on the 20% of situations that occur 80% of times.

for waymo itself, you can overfit on 100% of the situations that will be encountered. 49 square miles isnt that large. its the real world outside that which im concerned about its efficacy in. i think if you put a waymo in a small town that no alphabet engineer has ever even heard of, then youll see it fail badly as well.

FSD is a reinforcement learning problem, and we have no good way of training non-simulation algos for that. and a real dynamical driving environment cant be simulated accurately enough

seanhunter

Waymo works in a remarkable range of situations. I took a waymo in LA and our route came through an awkward four-way intersection at the crest of a hill on a residential street. Another driver went through the stop when we had right of way, saw us and then just stopped, completely blocking our side of the road. The waymo just backed up a couple of yards and then slowly went round the wrong side and proceeded on its route. That is, in a weird situation it did exactly what a good, cautious human driver would do. Small sample, but it makes me think they are not doing what you say, they are just actually trying to approach the problem seriously rather than Tesla’s “full speed and damn the torpedoes” approach.

breadwinner

> if you put a waymo in a small town that no alphabet engineer has ever even heard of, then youll see it fail badly as well.

Which is why it is a non-goal for Waymo. It should be a non-goal for Tesla too, given the state of the art.

sorcerer-mar

It's hilarious to see Tesla fans try to act like designing for an undefined operational domain is somehow extra brilliant and not one of the stupidest fucking ideas anyone has ever come up with.

chronic0262

> i think if you put a waymo in a small town that no alphabet engineer has ever even heard of, then youll see it fail badly as well.

Waymo is not claiming to work in small towns.

Tesla is. Soon™.

amscanne

San Francisco, Phoenix and LA represent a strong diversity of driving conditions. Certainly not all driving conditions, but no one is throwing a Waymo into a small town in the way you describe. Expanding slowly and cautious seems like the rational thing to do, I’m not clear what you are proposing as an alternative (or specifically what the alleged fraud is).

Marsymars

> San Francisco, Phoenix and LA represent a strong diversity of driving conditions.

This could very well be true, but if you’re looking at it from a perspective of someone who lives in a rural area with real winters, for driving purposes, those all look like pretty much equivalent large American cities without a winter.

findthewords

As a control engineer who knows something about sensor fusion - No LIDAR no ride. Musk can brute-force his unsafe robotaxis on the road but they won't be as safe as Waymo. Maybe people won't care if the price is slightly cheaper vs. competition, I don't know.

dazc

The non-technical answer is that people do not care so long as it's safer and less unpleasant than the current alternative.

My last taxi ride involved jumping red lights and speeding through residential streets at 60mph because, I assume, it was early morning and the driver had learned from experience that he could get away with driving like this.

The previous experience to this was a lecture about a certain religious ideology and how I should spend the next two weeks reading up about it.

gdbsjjdn

Remember that the robotaxi industry is currently doing everything they can to look good. They are being watched like hawks. Look at how everyone was horny for Uber rides, until Uber needed to actually make money so they jacked up fares, cut driver pay and let anyone with a piece of shit car join. Or how Google search has been enshittified.

In 10 years when robotaxi companies are short on cash and trying to IPO they will absolutely start speeding. They'll lock the doors and give you a paid presentation about Scientology during your ride. "Accidentally" drive you to a competing store that paid for sponsored traffic, instead of the .

madaxe_again

Over the years, I’ve had four human driven taxis crash, and two taxi drivers rob me.

scrollop

Never heard of those two occurrences happening for a taxi customer, ever.

Perhaps you live in a location that lends itself to such events...

apparent

I'm curious to know how you would act as a driver, cyclist, or pedestrian if you saw a Robotaxi nearby. Would you be more cautious, and if so in what way? Or are you mostly worried about LIDAR-less vehicles running into white walls, which it can't identify as solid walls?

adastra22

Removing LIDAR was the eye-opening moment for me re: Musk. The justification given at the time was technically bogus while it was so obviously in response to supply issues during COVID. If Tesla really wanted safe FSD they would prioritize sensor quality and multimodal input. They went for the bottom line instead.

bryanlarsen

Tesla's never had LIDAR to remove. They had short distance ultrasonic parking sensors that they removed.

tzs

They also had and then removed radar.

_giorgio_

Not true, they had lidar in at least one model. It's written in his bio too.

kamranjon

The part that I always found difficult to square was not that Elon Musk towed this “no need for LiDAR” line so hard, but that Andrej Karpathy, who I generally consider a very reliable voice in this space, was also in strong agreement that cameras were all that was needed. Does anyone know if he still believes cameras is all you need?

Edit: Here is a link to Karpathy discussing the trade-offs: https://www.youtube.com/watch?v=cdiD-9MMpb0&t=5276s

chronic0262

> but that Andrej Karpathy, who I generally consider a very reliable voice in this space, was also in strong agreement that cameras were all that was needed.

You really expect a Tesla employee to speak out against Elon?

Especially when $10M+ TC is on the line?

sgt101

Andrej "train it on more data and the problem will go away" Karpathy

Joel_Mckay

Many LIDARs are blinded by direct Sunlight, and often see highly reflective surfaces like mirrors as black hole or distant ranged areas. These still need tertiary safety sensors like mm RADAR for safety in dust/rain/sunlight.

In cities, high-speed rail and e-bikes make more sense than a honking traffic jam at 4am. lol =3

tlogan

I have a question:

- What are the main challenges in building software that relies solely on camera input?

- Which specific modules or tasks still require LiDAR to function reliably?

findthewords

Camera vision and LIDAR perfectly complement each other. Camera vision is no good detecting unknown/outlier obstacles quickly and accurately. LIDAR is great at detecting unknown obstacles quickly and accurately.

You can tune the camera obstacle detection to be hyper-sensitive, which results in phantom braking, causing Passengers to feel that the car is "unreliable" while it actually is safer. Humans are better at braking the appropriate amount when they see something strange, dynamically tuning their sensitivity in a new situation.

You can lax the sensitivity, which will reduce false alarms, but will actually cause more crashes, deaths, and injuries. You don't want your customers to feel unsafe, so from a business perspective you will inevitably reduce the sensitivity.

samrus

can binocular cameras replace lidar you think? they should result in just as reliable distance estimation

djaychela

No, they don't. Look at what has happened when a tesla has mistaken a motorcycle with two small rear lights that is nearby for a car that is further away but with the same lighting configuration. Did not end well for the motorcyclists.

He's just wrong about this.

Grimblewald

I dont think it's wrong, but i do think models avaliable right now lack the inductive bias required to solve the task appropriately, and have architectural misalignments with the task at hand that mean for a properly reliable output you'll need impossibly large models and impossibly large/varied datasets. Same goes for transformers for language modelling. Extremely adaptable model, but ultimately not aligned with the task of understanding and learning language, so we need enormous piles of data and huge models to get decent output.

maxlin

You know quite little. No one has the kind of training data generation as Tesla does, and cases like what you describe were already discussed in 2017.

LIDAR will forever stay a niche technology. If it was so notably "better", Tesla would have just scaled that. But they went all in on vision because it has worked for 100+ years.

findthewords

They are complementary sensors. It's a much easier engineering feat to combine two (cheap) sensors that are good at different things and fusing this information than creating one perfect sensor that does everything.

Private moon landers (the Japanese being most recent one) keep crashing because they rely on a single high-quality altimeter and expect it to work perfectly, all the time. If they had a complementary low-quality backup altimeter that operated independently, they would have had a less failure prone distance estimation system.

typewithrhythm

Can cameras do it eventually is a bit of a tangent.

All the information is there in a video feed, but the amount of work to get reliable perception from it is not small. With LIDAR and radar you get to the end goal with less uncertainty.

rainsford

The real key is that things like LIDAR are designed to work well with the types of tasks computers are good at, like taking a bunch of precise measurements every second and performing complex calculations, while a binocular vision based understanding of the world is something humans are good at because we evolved that ability over millions of years.

You can probably eventually ("never" is a long time after all) get a computer to understand the world as well as a human purely through camera based sensors, but it's a much more difficult task than taking an approach that uses tools computers are already good at. Similarly, I suspect it would be an uphill battle to have a human drive using raw LIDAR input.

findthewords

Absolutely. The goal of self-driving is to be better than human drivers. Even the best drivers struggle with the sun shining from low angles, or road reflections, or snow, and so on.

loloquwowndueo

Ever heard of optical illusions? If a brain can be fooled by input from its two cameras like this, what hope does a dumb (or worse, artificially “intelligent”) computer have?

doctorhandshake

I think optical illusions are a poor choice to illustrate this point. They are manifestations of the corner cases, peculiarities, and side effects of our visual processing system and neither cameras nor Lidar are without their own analogous issues.

DennisP

Would Musk's argument about sensor fusion have made any sense back when they were doing lots of hand-coded C++?

I've been thinking maybe vision-only was a reasonable decision, back when lidar was expensive and the software was hand-coded. Now it doesn't, because lidar is cheaper and the software is and end-to-end neural net, and additional sensors are just more inputs to the network which will learn to use them. But Tesla is locked in because of the promises they made to early FSD buyers.

AlotOfReading

Sensor fusion is pretty straightforward. You can think of it like sorting algorithms in CS. There's a bunch of standard techniques simple enough to teach undergrads that work fine in production, and enough technical depth beyond them to last the rest of your career.

If you actually look back at the E2E tweet, musk only says that the NN replaced 300k lines of "control code". Control code usually doesn't encompass the entire AV software stack, but neither should it take 300k LOC. As far as I'm aware no one is 100% sure what they mean by E2E and if it's actually the standard meaning or something else that's been widely misinterpreted.

maxlin

Their engineers, who obviously are on the bleeding edge, going out of their way to avoid sensor fusion issues says something quite different. I could believe "Straightforward" could maybe apply for something many tiers below in complexity and safety requirements to what they're doing. But adding non-agreeing, non-uniform information sources to the most capable real-world ML vision system not driven by human-engineered code?

I don't care even if you said you had 70% of the experience their team has, what you say can't sound reasonable or caring for actually improving safety in numbers.

general1726

> and the software is and end-to-end neural net,

Well considering Musk record for adherence to reality, question is if you can really believe that or if Musk thinks that this is happening or it is not happening at all and Musk is just making it up.

DennisP

Given what's happening in the rest of the AI field, it seems pretty likely that it's correct.

Plus various Tesla engineers have said the same thing, Tesla does have a very large AI training cluster, and FSD quality made a big jump when they claimed to deploy end-to-end.

Jyaif

You've got it exactly backwards.

When the software was hand-coded, having Lidar and a high-res map was vital.

But if you have a good enough AI, sensors that replicate the human senses are all what is needed.

The real question is: when will we get good enough AI that can be applied to all cars?

DennisP

The question isn't whether it can be done eventually, but whether it would get safer faster with extra sensors.

Back in the day, Elon's specific objection to lidar was that it was too hard to code the sensor fusion part. With end-to-end there's no coding to deal with.

And it's not like they've replicated the visual cortex. It's the same neural net technology everybody else is using. It can deal with any sort of sensors just fine.

CyberDildonics

> But if you have a good enough AI, sensors that replicate the human senses are all what is needed.

What is your example or evidence for this?

dham

It's not "Musk's argument," it's Andrej Karpathy's.

Also, if you've ever done any ML you would note that more data isn't always better. Plus there's the piece about which thing to believe when you get conflicting data. It's a lot more to it than what random Hacker News people are saying in this thread.

DennisP

Conflicting data is an issue even when you just have lidar, and it's not hard to deal with.

The cofounder of Waymo taught one of the first Udacity courses on this subject. He went through a small Python project that processed lidar point clouds for self-driving. The data is noisy, you get conflicting information from different points, and the code aggregates all that into the most likely 3D model of the world.

Additional sensor inputs are just more of the same, and neural nets are pretty good at this sort of thing. They'd even learn which sensors are more reliable in different scenarios.

As for "more data isn't always better," I've mostly seen that applied to training, not inference in real-time control systems. Even for training, it turned out people had been fooled by a local maximum, and once past that, more data really was better.

tiahura

What version of Lidar does your head have?

general1726

Counterquestions

- What living creature is using wheels to move around?

- What kind of birds come strapped with a jet engine?

Sometimes non-natural solutions are easier and often better than attempt to replicate nature for every cost. Imagine your logic applied on a plane - birds flap their wings, thus this 737 should spread it wings and flap away like a goose. Now take military goose and flap fast enough to get supersonic...

vidarh

> - What living creature is using wheels to move around?

A human driving a car.

I agree with you that sometimes non-natural situations are easier and can absolutely be better, but the point of bringing up humans is generally to show that it demonstrably is possible to do at least as well as humans, with humans as an existence proof.

But that it might well take too long and cost too much to get there, and that it might well in the end be cheaper and better to use additional types of sensors is a good point.

rainsford

There's no reason to think the best performing, or even adequately performing, technological solution to a problem would mirror how humans have solved it. Submarines don't swim like fish after all.

But more specifically to this case, human eyes are attached to brains with (generally) vastly better image recognition and reasoning abilities than any camera based self-driving car. Because of this, humans are better able to recognize visual input even in degraded or unusual conditions compared with a computer.

staplung

That's a bit like saying cars should use legs instead of wheels.

(Also, I don't know what star-system you grew up on by my lidar sensors are next to the tubular sheaths on my cephalothorax, right where Xoc'tlz'ik (the Creator) intended them to go.)

DennisP

My head contains intelligence hardware that far outstrips anything in these cars. Plus my cameras are a lot better.

Despite all this, a lot of modern cars are adding lidar to make things easier for me.

seanhunter

Your head has a general intelligence, so it can do sensor fusion in a way a car can only dream of.

4b11b4

It's not that we lack lidar, but we what we have in addition to "cameras".

We possess a spatial intelligence (e.g. how your brain has an approximation of: It feels like I walked three blocks) that will never exist in this "photons-in" "controls-out" fantasy.

rainsford

There's a solid argument to be made that solving the self driving problem using only cameras might end up being roughly equivalent to solving the AGI problem because you will have essentially created a computer with a human understanding of the world around it using human senses.

maxlin

*who wasn't able to get a job at Tesla and knows only of non-scaling, unproven technologies

Waymos which cost as much as an actual taxi and aren't scalable are nothing but a VC money carnival.

codechicago277

“On Monday, Musk thought it would be funny to expand the area covered by its three-week-old Austin robotaxi service to resemble a giant penis when seen on a map.

“Harder, better, faster, stronger,” the $1 trillion company wrote on Monday, a double entendre referencing the synth pop track of the same name by Daft Punk, a duo appropriately known for performing as robots. Musk approvingly reposted the phallus-shaped service map, adding the fare would now be hiked to $6.90 per ride from $4.20 previously, both numbers the 54-year old often employs for comical effect.”

It’s amazing that anyone still takes him seriously. One of the first riders almost hit a train, and this is what he’s spending his time on. It’s inexcusable, but his fans lap it up.

buran77

A decade ago his antics were seen as whimsical and perhaps funny, especially to his fan base. With that fan base ever shrinking his antics today are disgusting and trying to appeal to the crowd which still appreciates something this low-brow.

whendiduassume

It's like a different dumb jackass assumed that role some time ago.

Why would they use what was a science role model that way?

dylan604

Why the boards of directors of any of his companies do not ban him from making social media posts from his personal account is beyond me.

AtlasBarfed

Nazi salutes won't be forgotten.

On national TV.

In a presidential inauguration.

A permanent stain on US history.

xyst

All billionaires are permanent stains on US history. Musk is just the poster child for this behavior.

madaxe_again

The Bellamy salute is as American as it gets. You’re meant to do it while you pledge allegiance.

https://en.m.wikipedia.org/wiki/Bellamy_salute

privatelypublic

Need more info on this, because its really easy for somebody to stick a camera at an angle that if somebody waves at the crowd it becomes iffy.

Was interesting to see actual video of a newish public figure wave at the crowd, wince and look in the direction of the camera. Clearly newly trained not to wave at the crowd.

fullshark

Weird they didn't include a photo, tweet including commentary confirming the juvenile justification:

https://x.com/elonmusk/status/1944688226037325868

vigilantpuma

Probably because major news outlets are reluctant to include pictures of penises, even stylized ones, in their articles.

samrus

hes always been like this. from faking video games to pushing memecoins.

his being cringe itself isnt the issue. its the lack of EQ that leads to someone being a slave to wanting to be liked. it doesnt inspire confidence in his ability to think rationally. like how hes perfectly fine grifting and contributing to the decrease of trust in society. its messed up

soared

He was definitely not always like that, at least loudly in public.

Zambyte

He made a space rocket company called Space Sex and your choices of Tesla cars are S3XY. Maybe he wasn't like that in the PayPal days, but ever since he has been loud in public, he has been like this loud in public.

JKCalhoun

He lost me when he called (EDIT: REMOVED NAME) a respected cave diver a "pedo". (I guess 7 years ago now.)

rightbyte

I think you can estimate the later bound of his meltdown to when he called the rescue diver a "pedo"?

Bluestein

Business practices are being enshittified to the point of 4chan. Profit, for the lulz.-

Not so long ago you'd gain traction through insight or depth. Now it's absurdity that wins the price, vanity upon vanity.-

At some point the idiogarchs are going to celebrate (celebrate) their accidents and dead as a win. Lol.-

fullshark

They are "the men in the arena" taking chances pushing humanity forward, we are on the sidelines, doing nothing but criticizing people greater than us. Death is necessary for humanity to progress. Eleven workers died building the golden gate bridge, etc.

wat10000

Funny how people who live lives of unfathomable luxury are the ones “taking chances,” while the people who literally die in the process are just the price of progress.

Bluestein

I feared it sounded familiar. There it is.-

vigilantpuma

Musk is a clearly brilliant man who does not know how to keep his mouth shut or not act like a teenager. I know he doesn't need my respect... But he's certainly lost all of it by now.

And for people who are like "yeah but he gets results," are you really saying he wouldn't be getting more results if he didn't spend the last 10 years being an idiot online?

jeffbee

Citation for the "clearly brilliant" part?

noqc

> Musk is a clearly brilliant man

proof left as an exercise for the reader.

tiahura

“One of the first riders almost hit a train“

How many human drivers almost hit something?

tzs

Most of the time when a human does it is because they were either operating the car while they were tired or ill which interfered with their ability to pay attention or they were doing human stuff that distracted them such as dealing with kids, talking to others in the car or by phone, daydreaming, looking at something interesting on the side of the road, panicking because they just noticed a big spider on the ceiling above them, and so on.

A self-driving car should not get tired. It shouldn't be doing any robotic equivalent of those things that distract humans.

This is why almost hitting things is a bigger deal for self-driving cars. Humans are expected to almost hit things, because we do a lot more than drive cars and we are easily distracted.

A self-driving car is a specialized system designed for that one task. If it almost hits something it is either a sign that there is a flaw in how the system works, the real world testing was not good enough, or it has hit an extremely rare edge case

JKCalhoun

I wonder: when a human does it "we" have someone to blame. I think as a species we like that.

When a machine kills someone do we go after … the company? (Maybe we should all be shorting robo-taxi companies.)

steveBK123

In the 1000s of miles I have been a passenger in Ubers, taxis, etc.. I have never had one try to drive through a railroad crossing.

null

[deleted]

jqpabc123

“The fact that they’re hiding data should tell you everything you need to know. If you really want trust, you have to have full transparency.”

Anything Musk says is simply not trustworthy.

Not just my opinion but proven over and over again.

Hiding safety data is just icing on a cake that he has been baking for years. The real problem here is that those who choose to trust him and his companies are putting others at risk.

Those who own/drive a Tesla typically have insurance but what about those who hire robotaxis? Can they be held personally liable when their roboride hurts someone?

DustinBrett

These are like articles saying why Tesla won't make an electric car. Just more doubters to be proved wrong, again.

maxlin

Pretty much. Has the air of the oil&gas funded "journalist" piece where he ran circles in a parking lot then wrote about it suddenly running out of battery, and was disproven by logs lol

avidiax

Having worked at Uber, I can tell you that most people vastly overestimate how many Uber drivers are working at any one time. A medium sized city like Seattle might have a few hundred at peak hours.

There is a limited scale to any taxi service, at least until it becomes cheap enough that the company can afford to have lots of cars sitting parked and idle for much of the day. Otherwise, the rush hour peaks will be less convenient and affordable than having a private car.

itsoktocry

Or like the solar roof, battery, swap, Cybertruck best selling vehicle of all time...you know, things people said wouldn't work, and didn't.

Elon has a good track record, but he has some duds in there too.

chung8123

Didn't Tesla start as an electric car maker?

ArtTimeInvestor

The whole article is based on an incident a YouTuber talks about in one of their videos. The incident was not captured on video and was not even described as dangerous by the YouTuber himself.

I would say if that is all you have to discredit the Tesla robotaxi project, then the project seems to go pretty well.

nerevarthelame

The whole article is not based on that incident. For example:

>The former U.S. Marine hosts the crowd-sourced FSD Community Tracker, the single most sophisticated and reliable form of empirical data collection and analysis on Tesla’s self-driving technology that is publicly available. Car executives like Volkswagen Autonomous Mobility CEO Christian Senger speak highly of it as a benchmark, and even Musk—who has his own internal data on disengagements that he refuses to share—singled it out as proof the company is making progress.

>Currently, its data shows even the latest FSD version from Tesla results in a critical disengagement roughly every 340 miles between both city and highway at present. Called 13.2.9, it rolled out in May just weeks before the Austin service launched. “You sometimes hear Elon saying, ‘we’re having a hard time finding disengagements.’ That is such BS,” Martinez adds.

shcheklein

To be fair. I live at Mission Bay (SF) that has Caltrain railway nearby (and you have to cross it if you take particular ways in/out). I drive (and like it a lot!) Waymo. Waymo avoids crossing it (it takes a longer way to drive a bridge). So, they probably realized the risk and still to this are not willing taking it.

maxlin

This article will age so badly lol.

Tesla's architecture is the only one of the robotaxi providers which actually _can_ scale. Not being dependent on exact HD maps, having the same standard as humans do "if you can see enough to drive" means eventually there'll be scant roads Robotaxi can't serve. By this strength it'll serve in areas that would never work for LIDAR/pre-HD-mapping requiring solutions

renewiltord

Saying Elon Musk won’t succeed at something that is a hard technological problem is foolish, yes. His companies have done what everyone said was impossible for ages.

But I do wonder if rising nations will instead just build their infrastructure to line up with technology (e.g. HD mapping their streets as they build them, installing signed beacons to inform AVs). The cost of this tech is cratering. One possible future, though admittedly an unlikely one.

Closi

Tesla Robotaxi is a classic case of premature optimisation - with Waymo they decided to deploy whatever technology worked best and did not cost-optimise at the start. Each Waymo vehicle is much more expensive than a Tesla, and has much more expensive sensors and compute.

Tesla on the other hand started with a load of constraints - smaller amounts of compute, cheaper sensors, needs to hit a price point as it will be installed in every vehicle sold - can't be $50,000 of dedicated self driving hardware per vehicle.

There are some scenarios where constraints lead to breakthroughs, but often for true-moonshot projects it is the opposite (see: Space shuttle, System/360, the manhattan project, LHC etc)

redox99

Tesla approach is so much better financially (leaving aside morality and false promises).

Waymo has sunk billions of dollars with almost 0 return yet.

Tesla has developed FSD basically for free, because people pay for software that isn't there yet, and Tesla doesn't waste money on expensive hardware.

dchftcs

FSD itself is not a failed bet as a driver-assist system. When it started Tesla was cash poor and often on the verge of collapse, so cutting costs made sense. They will never do as well as a mature Lidar-based solution, but over the years FSD added some value to some people, and might turn out to be a slight competitive advantage in selling cars.

I also think Tesla and their robotaxis are egregiously overhyped, but cutting Lidar was not a terrible business decision at the time. Though it's a terrible decision to have still stuck to vision-only (and using low-quality cameras apparently) when they could have at least got Radar and cheap Lidars.

ec109685

If the key unlock for self-driving is maximizing real-world training data, then Tesla’s approach of using cameras make sense since it allows them to utilize their entire fleet to deploy incrementally better FSD to.

ChrisMarshallNY

I'm actually kind of stunned at the report by the guy that almost got turned into chum by a train.

The stan is strong, in that one...

diamondfist25

I use fsd all the time it’s really good

What is everyone smoking? TDS? MDS?