Host David and co-host Paul welcome Vinod Namboodiri, Ph.D., Director of the Center for Community-Driven Assistive Technologies at Lehigh University and a Sights for Hope board member. Vinod shares how his experiences with progressive vision loss inspired his research into assistive technologies. He also discusses his work developing MABLE Maps, an innovative app designed to help people with vision loss navigate indoor spaces, and his vision for expanding accessibility through technology. This episode premiered on WDIY Lehigh Valley Public Radio.
Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.
Transcript
From the show. Tap a time to play from there.
Announcer 1Defeating Darkness with Dr. David Rimberg and co-host Paul Miller is brought to you by Sights for Hope. Serving the Lehigh Valley and Monroe County, Sights for Hope empowers people who are blind or have visual impairments to live confidently by teaching skills, delivering supports, and championing assistive device solutions. At Sights for Hope, we believe that everyone deserves the opportunity to clearly see what's possible. Find out more today at SightsforHope.org.
David Rimberg, Ph.D.Welcome to Defeating Darkness. I am David Rimberg.
Paul MillerAnd I am Paul Miller.
David Rimberg, Ph.D.Together we will explore how we achieve purpose with our loss of vision. Today's guest is Professor Vinod Namboodiri, who is developing a technology for people who are visually impaired to be able to be self-sufficient that will be used throughout the world.
David Rimberg, Ph.D.Professor, could you please tell us about your background?
Vinod Namboodiri, Ph.D.Hello everyone. Yeah, thanks for having me here. Very happy to be here. So I'm a professor at Lehigh University. I have a joint appointment there between the Department of Biostatistics and Health Data Science in their College of Health and in their computer science and engineering department in the Rossin College of Engineering. At Lehigh, I also direct the University Research Center called as Community Driven Assistive Technologies or CDAT. So I've been very happy to be at Lehigh for the last few years and look forward to telling you more about myself.
Paul MillerProfessor, what has your personal experience been with vision loss?
Vinod Namboodiri, Ph.D.Thanks, Paul. Yeah, so I was diagnosed with this visual condition called Retinitis Pigmentosa when I was about 25. I was told that I would keep losing sight and eventually go blind at some point. Okay, so this condition has always made it difficult for me to see in low light, like darkness. And it also increasingly leads to narrowing tunnel vision. So things become narrower. It's like looking through a pinhole at some point, right? So I knew that it was progressively going to get worse starting around age 25, even though I think I've had experience with it even before, it's just that I didn't know about it.
Vinod Namboodiri, Ph.D.So I've been fortunate that my progression has been slower than maybe what uh many others typically face, but there is still progression and it's progression to blindness eventually. So it has been challenging to deal with in some sense because there is always a constant pressure that you are losing time in living life the way you actually have lived it in the past, right? So this is how you know how to do things, and you know you may not be able to do it in that way going forward.
Paul MillerI certainly understand I have the same condition as you do, and I didn't find out until I was 35. Prior to that, I thought my vision was great. But looking back, I recognized that uh I played baseball in uh high school, and that the coach said, watch the ball. Because I wanted having trouble hitting the ball. And I said, I can't see the ball at all. But I never realized that it was that, and that constant change that happens with the progression of the diseases is always a new challenge looking over at the horizon.
David Rimberg, Ph.D.About my vision loss, it was due to glaucoma, which was inherited from my father's side. And I've spent the last 15 years with drops and surgeries, and the last three years I went totally blind, and dealing with has been a very emotionally challenging activity. But now I wake up every morning and there's that mountain to climb. There's a lot of struggle, sometimes it's very exhausting, but I like to think of myself as even though I can't see, I can overcome.
David Rimberg, Ph.D.How did the loss of vision affect your career path?
Vinod Namboodiri, Ph.D.I realized at some point that I kind of experienced this on the personal side, right? So the challenges thrown by low vision and blindness. But my work as an engineer, as a computer scientist, was trying to solve different problems. And as a university professor, I could get to do research in solving societal challenges. So that was my work, which was kind of difficult to have working on two different challenges during the day and later in your personal life. When I realized this is not going to be easy, I thought, okay, as a university professor, the one good thing we have is we typically get to pick the challenges we want to work on.
Vinod Namboodiri, Ph.D.Of course, you can use your expertise. So I thought, why don't I look at challenges posed by disability? Look at things like assistive and accessibility technologies. So I started doing only that as my research as well. I learned more about the area, I looked at the literature, what was the current state of the art. Remember, it is not easy. People start learning things to do these things quite early when they are younger. I did this change when I was maybe about 30, 35, is when I started thinking maybe I'll work in this area.
Vinod Namboodiri, Ph.D.And so it's almost like doing a Ph.D. all over again in a different area. But the prior training was useful, right? And computing is always useful. We use technology in so many ways. So I was slowly able to kind of get a better idea of how I could maybe use my background and work in this space. That's how I adapted. And being at a university, the best thing is you have research collaborators, you have students you get to work with, right? And students are always eager to look at the next technology, the next problem to solve.
Vinod Namboodiri, Ph.D.So you essentially can feed some of these challenges to them and they can start working with you on this. So essentially, I am going to say I feel I actually am lucky that the where I am in the profession I was, right, that I can actually work on solving it because one of the biggest challenges in with this kind of condition is you feel helpless. You keep waiting for a cure and it's not in your hands if there is a cure or not. What can you do while you're waiting, right? And not to feel helpless. I was lucky that I could adapt my career to work towards solutions, maybe slightly different solutions.
Vinod Namboodiri, Ph.D.It doesn't cure low vision or blindness, but perhaps helps people adapt to this better. So that's how I feel I have been able to adapt. And as I said, I have to continuously still adapt, but that's a journey that I'm on.
David Rimberg, Ph.D.Were you at Lehigh University at the time you decided to change your career?
Vinod Namboodiri, Ph.D.No. So I was at Wichita State University. This is in Kansas. So I was fortunate that there was a low vision research institute there, known as Envision Research Institute. So I was able to actually work with them, spend more time with that institute, know how blind and low vision folks essentially how they work, what are the challenges they face, and start using that knowledge and applying my computing background. So that journey started about, I would say, 10 years back. And I moved to Lehigh only about three years from now.
Vinod Namboodiri, Ph.D.So I had already established my work in that space, and I was fortunate Lehigh was looking to grow expertise in that area.
Paul MillerProfessor, you mentioned that you were the Director for the Center for Community-Driven Assistive Technologies. What is the mission of that center?
Vinod Namboodiri, Ph.D.This is a new center that we established at Lehigh just last year. OK, so the center was kind of created because we noticed that there are all these disability challenges out there, and we need different disciplines to solve these kinds of challenges. So if you think about disability challenges, it cannot be solved just in engineering or just in psychology or just in health, right? You need everyone with different backgrounds to come together, right? So there is the policy of things, there is the economics of things, there is the engineering of things, there is the psychology of things.
Vinod Namboodiri, Ph.D.So you need to put everything together to make long-lasting solutions. So at Lehigh, we have five colleges. We wanted to put all these colleges together in a common framework to work on disability challenges. So that's where this Center for Community-Driven Assistive Technologies came. So we set this up so faculty and students could come together with the community. The challenges come to them, they create the solutions, hopefully, co-designed, there is co-participation with the community, and the solutions eventually translate back to those who actually need them.
Vinod Namboodiri, Ph.D.I am just lucky that I was at the right place at the right time. I had just moved to Lehigh, and we had this big group of faculty who wanted to work in this space. So everything came together, and we are hoping at Lehigh this allows us to grow in the space with various community partners.
Paul MillerYou know what instantly comes to mind when I hear this is that it really spreads the word and also makes people more aware of other people with disabilities in a very broad scale.
Vinod Namboodiri, Ph.D.Yeah, actually, we felt there is so much common in terms of challenges that the center could take on all of them together. Of course, you would still need more customized and personalized solutions, but there is still so much in common across people with disabilities and their challenges that they could be handled together. So, as part of the center, we are very excited to hopefully create solutions that can get to the end users and make life easier for everyone. So the center has three focus areas of impact, as we call it.
Vinod Namboodiri, Ph.D.The first one is what we call as life transitions. How do we help individuals with disabilities transition across different life stages? For example, somebody who is in high school moving on to let's say post-secondary education, perhaps somebody going from maybe a retirement age to aging in place, assisted living, all these transitions happening much later in life as older adults, right? So those throw new challenges at individuals. So that's what are what we call our life transitions area.
Vinod Namboodiri, Ph.D.The second is what we call as mobility and access. How do we help individuals with disabilities move around the community and access different physical and information infrastructure? Okay, and the final area that we have is what we call as smart spaces. How do we enable individuals with disabilities to move around and live independently, perform activities of daily living in spaces that they spend time in, like your home, at your workplace, maybe in your learning environment?
Vinod Namboodiri, Ph.D.So with these three focus uh areas, we feel we can cover a lot of the challenges that exist currently and hopefully develop better solutions.
David Rimberg, Ph.D.Professor, one of the areas you discuss is uh smart spaces. Can you in detail discuss uh some of the contributions uh and projects that you're working on in that subject?
Vinod Namboodiri, Ph.D.So this is the project I'm most passionate about, which is what we call as MABLE Maps. MABLE stands for mapping for accessible built environments. What we are specifically building is maps for indoor navigation. Okay, so one of the first things I learned when I moved to this space is people with vision impairments were doing reasonably okay navigating outdoor areas because you had satellite services like GPS and Google Maps, so right.
Vinod Namboodiri, Ph.D.So it gives you some context of what is around you. But as soon as they moved into indoor spaces, they did not have any information on their fingertips, like what is around me, what is the best way to get from point A to point B in this large unknown building. So I realized that they always had to go somewhere with somebody else if they were going to unfamiliar environments, right? So it defeats the purpose of building that independence into mobility and access.
Vinod Namboodiri, Ph.D.And in general, helping individuals with vision impairments to feel comfortable in venturing out. So I felt with my computing background, perhaps I could add a way to provide that information, that missing information. So what we did is essentially slowly work on multiple federal funded research projects to map indoor spaces, but also more importantly, know where you are in an indoor space, right? A map is more useful if it can pinpoint where you are currently.
Vinod Namboodiri, Ph.D.So you can essentially give turn-by-turn directions. Like just like Google Maps says, go straight, turn left, right, drive straight. We wanted to build this MABLE Maps technology that you can walk into an indoor space, and if you wanted to, let's say, go to the restroom, you can tell the app, which is what we have, MABLE Maps app, that hey, I want to go to a restroom. It will look the map up itself and tell you, okay, you can go straight 10 feet, perhaps turn left here, then turn right at the next intersection.
Vinod Namboodiri, Ph.D.So just like Google Maps, it can actually get you to the restroom. You also have an exploration mode in this technology where you can just walk around and it'll describe whatever is around you. So you can just essentially comfortably just move through an indoor space, whether you're blind or visually impaired, just learn what is around you, develop your mental map, right? Once you know what is in the building, it becomes a lot easier. So this is something I've been working on for almost 10 years at this point. Again, it's not easy, it's just like a self-driving car kind of thing.
Vinod Namboodiri, Ph.D.It takes a lot of effort on the data collection side, on the modeling side, on the user interface side. So this is the technology that I'm most excited about.
David Rimberg, Ph.D.Do you have any specific location that the public would know where this technology is being used?
Vinod Namboodiri, Ph.D.Yeah, so we started with deployments at Lehigh University. We also did pilot at Good Shepherd's Highland Center, which is in Allentown. The site that I'm most excited about is our latest site at Sights for Hope in Allentown as well. So we have it deployed so that anyone can just come in, download our app. So right now our app only works on iPhones or iOS operating systems. Right? So they can download the app and just find their way in this building.
Vinod Namboodiri, Ph.D.And we would love to actually get feedback from the community how it's working out. We hope to expand into many more sites, not just regionally, but nationally and hopefully one day internationally as well. So everyone can travel without fearing the anxiety that I don't know where I am or how do I go from point A to point B. We believe it can be used for all large, confusing places like hospitals, airports.
Paul MillerYeah, Professor, that sounds to me like a really important thing. I know that uh I travel a lot, and going to a hotel is really challenging if I were to do it by myself. Even though I have a seeing eye dog, a seeing eye dog will only be able to repeat that once they've been there the first time. So being able to travel independently would be just such an awesome thing. Do you believe that this can be also implemented in airports?
Paul MillerYou know, and even quite honestly, in grocery stores or that type of place that people who are blind and visually impaired could use the assistive technology?
David Rimberg, Ph.D.Yeah, definitely. I think any place which is large and confusing, right, would naturally blend into something like this. Yes, there is some work that needs to be done where we need to go and do some of the mapping, but once we do that, any place becomes accessible, at least in terms of the information about the space, right? Typically, those with sight gather that information as they walk into places, right? So those who are blind or low vision actually need that information to be collected up front and presented to them. So that is what we do as part of this application is to collect that uh information up front and use some of the latest AI technologies to recognize where you are in that space and then give you instructions on what is around you or where you need to go next.
David Rimberg, Ph.D.How do you get the information on a building or an airport or a facility so people who are visually impaired can actually navigate that building?
Vinod Namboodiri, Ph.D.Yeah, so that data is the key part where we need to have information about that space. So part of it is the site that wants this would actually contact us and give us some of the information they have. For example, the floor plans of the place. That makes it a lot easier. But typically we have to go there and do a scan. Like we typically go with specialized hardware that collects the information that we need. So currently we go in manually and do these scans. We know that the data collection is going to be where the bottlenecks would be.
Vinod Namboodiri, Ph.D.What we are also working on is automating some of that process. We could use robots to actually move around these spaces to collect. We are also actually thinking of potentially using drones to actually collect some of this data. So any way we can make this data collection faster and scalable overall could actually increase the speed at which we can get these things out there into more places.
Paul MillerI understand that the technologies that you are developing might have had some challenges. Could you discuss that with us?
Vinod Namboodiri, Ph.D.Yeah, so there are two challenges which I can mention. So, first is often the question comes is how many users will use this? Is this going to be useful more than just a handful of people? And one of the things we kind of try to make them understand is that wayfinding and getting around is a challenge faced by everyone. Everyone gets lost in unfamiliar large spaces. It's not just for those who are blind or low vision or those with disabilities, right? There's so many people who can use this. I started with low vision and blind individuals, but then somebody using a wheelchair often wants the shortest accessible route to go from point A to point B using a ramp or an elevator.
Vinod Namboodiri, Ph.D.They benefit from this. Somebody using crutches, they want to walk the least, right? So if they can get more efficient routes, so this can provide you the shortest routes to go from point A to point B. We realize it can be used by those who have memory lost. They came a certain way in the morning, they don't know how to go back. They can use this. This can be used by those who want, let's say, emergency evacuations. Like if there is a fire in the building, you could use this technology to tell you what's the best way to get out of the building.
Vinod Namboodiri, Ph.D.So there are so many uses of this technology. We actually have to educate people that this is actually more of a very core foundational technology. It has so many applications. Yes, it benefits certain parts of our community more because their needs are greater, but it has so many other applications that it's still worthwhile to put these technologies in. And the second part, which kind of the challenges we often faced, is we built this knowing the needs of the end user. We only realize later that the ones who need to really help us put this in is the facility owner.
Vinod Namboodiri, Ph.D.We have now started trying harder to educate the facility owner why this is needed.
David Rimberg, Ph.D.What are the costs involved with getting an app and the buildings themselves, what are the finances necessary to uh provide this type of service in a building?
Vinod Namboodiri, Ph.D.Yeah, that's a good question. So we always expect this to be free for the end user, right? So the site to provision this infrastructure in this space, we expect essentially some kind of cost recovery based on the square footage of the space. If it's let's say 10,000 square feet, it's less work on our part to put it compared to something that's let's say 300,000 square feet. Right? So we are still working out the exact numbers at this point, as we are just a startup company that was formed earlier this year, but we expect to have these things ready for discussion if somebody wants to put this in.
Vinod Namboodiri, Ph.D.But in general, I think this would be typically very comparable or less than what it typically costs somebody to put a indoor bill, for example.
David Rimberg, Ph.D.Here's my understanding, or see if I'm accurate. The app will tell you you've reached one, two, three, four Broadway. Somehow you got there. And there'll be stairs, possibly a handrail, and the app will tell you that the there are five stairs in front of you and a handrail on the left. Then you navigate that, and then there'll be a mechanical electronic door that swings open towards you on the right. Once you get inside the lobby, there'll be directions to get to an elevator if you need to use an elevator.
David Rimberg, Ph.D.And that'll be 20 feet off to the right, and the audio on the Apple D describing that to you. Am I accurate? How how would you want to elucidate that more?
Vinod Namboodiri, Ph.D.Yeah, so actually the way you describe is something that can be easy. Easily done by the app. So the good thing is because everything is done in software, you can decide, or the facility owner can decide what information they want to give, and it's just in software. So they can describe the door in any way, they can describe the stair in any way, right? So the instructions just would flow through the app. It's very simple to modify the instructions, make it longer. Some people actually prefer less information.
Vinod Namboodiri, Ph.D.Somebody else could configure the app so that they want every little detail about what's inside. You can personalize it to each individual. If you have any site left, you can actually magnify the screen, you can see maybe what's on the screen, you can get an idea of the layout, or you can use voice and listen to instructions in audio. So it's very personalizable. One of the things we like about it is it is not built just for one specific disability. As I said, we want it to be as universal as possible.
Vinod Namboodiri, Ph.D.You can personalize it to get the information you want particular to your needs.
David Rimberg, Ph.D.Do you recommend at this point using a cane still?
Vinod Namboodiri, Ph.D.Good question. So cane is still needed. So an app like this is actually going to give you what I call as the big picture, right? The logical layout of what is around you, how do you go from point A to point B. It does not in real time detect what is in front of you, like for example, obstacles. It still wants you to use your cane for your safety. Its goal is to tell you where to go, right? How to get there, what is around you. It does not know if suddenly somebody put like a big box right in front of you.
Vinod Namboodiri, Ph.D.It won't know that. Because when we collected the data, if the box was not there, it won't know that the box is there now. So you would want to still use all your safety devices for knowing what is in front of you. Okay, this gives you that big picture information that you're missing.
David Rimberg, Ph.D.So I assume it'll also be true, other than a cane, if you have a service dog.
Vinod Namboodiri, Ph.D.Yeah, that would still be the same because the dog would not know the route information as well, right? So between the dog or the cane and this app, I think you are pretty much covered and able to move around a space.
Paul MillerProfessor, what is your hope for the future using this technology?
Vinod Namboodiri, Ph.D.Yeah, so in the immediate term, it's it's funny that you asked what is your hope, right? So we actually have a this deployment at Sights for Hope, which is 845 West Wyoming Street in Allentown, where the site is ready for anyone to come and test it out. We are hoping to get feedback from that site and hopefully get to many other sites in the Lehigh Valley. So that's kind of the immediate goal that we have with this technology. So I see this technology as a way that just like ramps made some indoor spaces accessible to wheelchairs.
Vinod Namboodiri, Ph.D.Yeah. So I would like to see every building not just have ramps, of course, but also this kind of technology. So people with low vision and all the other populations I mentioned have the right information to access things efficiently.
Paul MillerBeing a business owner myself, I can see how the knowledge or just the awareness of the things that you're talking about could be so incredibly powerful.
David Rimberg, Ph.D.Yeah, Professor, what what other projects are you involved with?
Vinod Namboodiri, Ph.D.Yeah, so this project mostly, as I mentioned, is about indoor wayfinding and navigation. Of course, just being able to move around indoors is not enough, right? You also need a way to move outdoors. If you want to find a crosswalk and go across, as a blind person, that's one of the big challenges I've heard the most because there is a big safety factor at that point. So I was able to recently work on a project with an inventor who actually came to my office sometime back, Burt Sutker.
Vinod Namboodiri, Ph.D.That he has the special technology, it's a special paint where if you put that on crosswalks, a specially designed cane or a smart cane can actually detect that paint. So you can now use this smart cane to detect crosswalks. Okay, so we were actually able to test this out recently at the sites for hope outdoor parking lots recently, and we hope to actually be able to do more testing. We were lucky to have Penn DOT involved with this testing as well.
Vinod Namboodiri, Ph.D.So you know that if the technology works, it can easily make it sway at least across Pennsylvania, just because we have all the right partners working on it. In fact, this is the kind of research I like, right? There is the the community involved, there is the the innovation, there is the state agency who perhaps in this case can actually help make it happen, right? So that's the kind of research I like, and this is just one more example of I think you know how we can all work together to make things better.
Paul MillerProfessor, I believe you know that I am the President of the Board for Sights for Hope. And now that you're a member of the board, what are some of the things that you'd like to see happen or some achievements that we could have having that position?
Vinod Namboodiri, Ph.D.Somehow I've felt that with my background, what I'm hoping I can do with Sights for Hope is to perhaps embrace more innovation, research, right? So not just provide services based on the tools and technologies we have now, but look forward and see what from the future can we essentially be a leader in adopting the latest technologies, perhaps helping design them, right? So do more research, working with partners like Lehigh University so that we are addressing the right challenges, using the latest technologies, creating the right solutions, right?
Vinod Namboodiri, Ph.D.So, for example, the Center for Community-Driven Assistive Technologies needs partners like Sights for Hope to bring the right challenges and the current limitations that we have so we can design the right solution. As a board member, that is what I'm hoping that we can look more into research and innovation to add on to all the great other services that we have right now within the Sights for Hope organization.
Paul MillerThat makes a lot of sense. Having all of the different people that uh use the services at Sights for Hope could be a benefit to being able to develop better products and better uses for it. So we're so happy to have you on the board.
David Rimberg, Ph.D.Dr. Vinod, I really enjoyed your conversation and our listeners are going to be wowed. And uh I want to thank you for being here and your contribution to a really important aspect of accessibility. Thank you.
Vinod Namboodiri, Ph.D.Thanks so much, uh, David and Paul for having me here. It was a pleasure, and I hope we can have these conversations more times in the future.
Paul MillerI'm Paul Miller, and thanks for listening.
David Rimberg, Ph.D.And I'm David Rimberg. Thanks for listening. Tune in next Friday at 6 p.m. and listen to Defeating Darkness Podcast.
Announcer 2Defeating Darkness was produced by Expect Good Media producer Lys Sparrow-Serraino and post-production editor Daniel Childs. A special thank you to assistant editor Logan Mackin, Colin Poole for the theme music, co-host Paul Miller, and host Dr. David Rimberg.
Announcer 1Defeating Darkness with Dr. David Rimberg and co-host Paul Miller is brought to you by Sights for Hope. Serving the Lehigh Valley and Monroe County, Sights for Hope empowers people who are blind or have visual impairments to live confidently by teaching skills, delivering supports, and championing assistive device solutions. At Sights for Hope, we believe that everyone deserves the opportunity to clearly see what's possible. Find out more today at Sightsfor Hope.org.
Sights for Hope client Skip Drake and his wife, Karen, join host David and co-host Paul to discuss how vision loss affects not only the person experiencing it but also the people closest to them. The couple shares how...
In the conclusion of their two-part conversation with host David and co-host Paul, Sights for Hope client Skip Drake and his wife, Karen, discuss the value of assistive technologies, support groups, and specialized...
Host David and co-host Paul welcome Daniel Lombardo, Past District Governor of Pennsylvania Lions District 14-K, and David León, Past District Governor of Lions District 14-U. They discuss the history of the Lions'...
Erica Vibert and Elizabeth Santiago from Sights for Hope share how individualized support makes a meaningful difference in the everyday lives of people with vision loss. Host David and co-host Paul, who have benefited...
In the second part of this two-part interview, host David continues his conversation with Kristin Smedley - the Pennsylvania mother who has become a national advocate, bestselling author, educator, filmmaker, and...