let's pretend you're a product manager at facebook shops i'm curious what success metrics or what goals would you set for the team hey guys i'm diana and as you guys know i'm the host of this channel so here i'm excited today to bring abhishek on the channel hey everyone this is abhishek i work as lead product manager at square prior to joining square i was at paypal where i worked for almost nine years haven't interviewed for nine years uh four months ago i started my interviewing journey and diana's youtube channel helped me a lot in
understanding some cool concepts on how to crack the interviews i ended up getting four offers one from square meta dole dash and lyft i ended up joining square because it aligned with my career goals happy to be here at your channel tiana that is so impressive so we're bringing abhishek back because he's succeeded in interviews and i as you guys know want to help you guys succeed in passing those product interviews to get the job of your dreams so today abhishek is going to do a mock interview with us and it's going to be about
30 minutes so we'll dive in ready for some fun awesome really pumped up and excited yeah let's do it so abhishek let's pretend you're a product manager at facebook shops i'm curious what success metrics or what goals would you set for the team again before we proceed can you talk to me about at what phase fb shop is right now yeah facebook shop started in 2020. during kobe they accelerated getting it out to the market to help small medium businesses and large businesses awesome um so give me a couple of minutes to collect my thoughts
and then what i would do is i'll share my screen with you so you can follow my thought process here is let me talk about the structure how i want to proceed forward with this question so let me start with what facebook mission is facebook mission is to give people the power to build community and build and bring the world closer together what you would see is what every shop is and how it aligns with equipment um so facebook shop basically gives businesses with sfp pages to build out their own storefront and then they can
show the storefront on the different surfaces on facebook and instagram they can upload their entire catalog and bring their users to the shop i think one smart thing that facebook did was it also partnered with players like shopify big commerce set commerce etc so people can bring their entire catalog from third party onto facebook i think one thing to think about is hey how does fb shop differentiate itself from facebook marketplace and why facebook needed to launch something like this facebook marketplace would be user to user and facebook shop can be more like brands or
creators to user for a brand what is their advantage to being on shops versus staying if they already have a shopify site yeah i think the big advantage that they would get on creating fb shop is the visibility like three million active users um right now facebook has both the features they can either take users from fb shops to their own site or they can have in context checkout lesser friction more conversion better for shops right now facebook is trying out native checkout but then all facebook shops don't have a native checkout a lot of
facebook shops link their product to the main site so user actually leave facebook go to the main site and that's where checkout happens uh as i go down right about the goals uh we may not have visibility in the full end-to-end funnel the last piece happens at the merchant one website got it thanks for calling that out what i will do is let me write down the target users or the target let me just call it target stakeholders for us okay right so i see these as the primary stakeholders brands or businesses who build out
the facebook shop uh buyers who go to these facebook shops to buy something facebook who is the joining hinge of the entire ecosystem i've also added advertisers there because i think this can be a great strategic importance for facebook because now they know the buyers purchasing behavior they know what different item sellers have which items are popular this can definitely feed into having very targeted ads on the facebook i will probably focus on the top three advertisers is something i would keep back of my mind so a quick look at the facebook shop you would
see that right now facebook shop is free there is no shop set of fee there is no listing fee a lot of marketplaces tend to have listing fee as well um facebook also takes a revenue cut of five percent on transaction but i read somewhere that they have waived off the fee for the first half of 2022. on your native checkout is no fee so i mean that leads me to believe that revenue is not a core goal adoption and engagement is uh let's quickly look at user journey then i live straight into the metrics
the meaty part i think for a user journey for a seller seller comes to facebook and i think the prerequisite for sellers to create a facebook shop is they have to have a facebook page and the numbers might have changed but i think it allowed for 2000 likes on a facebook particular page to open up fb shop i come to a page i open up my fb shop i can upload my catalog or different items to my fp shop or i can have a connection to say shopify credcommerce or bigcommerce and then import my catalog
once my catalog is imported i can get my shop ready and then open it for buyers now there are other several things for the manager that facebook allows that hey listing your products from facebook shop to marketplace or running ads to bring in buyers but we will not go in that depth for the buyers the user journey typically looks like i'm browsing my instagram feed or facebook feed i see my favorite creator i go to the profile or a facebook page and i see certain items listed but i see a link to facebook shop and
then i can discover this shop the blue app also has a shop tab where they show different products in the beginning but then the way they organize it is through sellers like well marketplace is more a product focus facebook shop is more seller focused so i can find different sellers and then i can go into their shop and look at different products that they're selling if the seller offers native checkout like you can buy right within the facebook you can click on buy now and buy the product if they do not then when you click
on the main cta you go to this site where you complete your transaction all shipping everything happens off-premise and then what i would do now is basically try to write down some of the metrics and from there we'll start seeing certain patterns and choose a not star metric uh one thing also i would love to discuss in the beginning along with the user journey is the value basically where users get value in their journey having looked at the journey i think the real value comes in when a transaction happens or when sellers find value when
the item that they have listed has been purchased by a buyer buyers find value when they're able to browse through different uh sellers products and they're ultimately able to buy a product that they like so i think that's where the value lies as we go through the metrics let's keep this value in our minds as well okay so give me a few minutes let me collect my thoughts and write down some metrics and then we'll discuss all right let me walk through sellers and buyers first through this journey and then i can talk about some
of the metrics for facebook as well that sounds good let's go through it and just if you can take short pauses in case i have any follow-up questions sure let me do that okay all right let's start with the top of the funnel awareness and acquisition the number of sellers who apply to shops were weak again my understanding of shop is it's not open to everyone you have to have a certain limit to like certain criteria to follow to do that uh first step would be how many sellers are actually applying to this program like
is there an organic demand to be part of it number of buyers wasting shops per week like now that we have created shops like is there enough top of the funnel traffic that is coming to the shops or not like are buyers aware that something like facebook shop exists or not visiting shops is that people clicking on the shop's tab or is that coming in through another channel what do you think yeah good point i think for now i have not restricted to listing through shop tab i think like i said shops can be surfaced
through ads on your feed it can be surface to explore tab on instagram like for whatever the sources if users are coming to the shop that means we have a critical mass of organic traffic that is coming and there is decent awareness and do we choose per week for an intentional reason for fast moving items i generally tend to not go for a month because that's a long time to get the data early data i tend to avoid daily because in cases like purchasing or social media sometimes we may have daily fluctuations like people are
more active on a certain day certain so we basically smoothens out all those fluctuation okay okay then the next step is basically in the funnel is activation now we may define activation as multiple different ways you can say a seller is activated when they have uploaded a catalog and prepared their shops i tend to define activation more is when is the key action that is done when as a seller in bahrain you have realized the true value that we talked about earlier i think the true value comes when the sale happens so what i'll be
tracking is number of new sellers with one plus item sold number of buyers with one plus item purchase and let's talk about how we will track selling and buying further down the funnel we can look at some proxy metrics and proxy data to figure out the sale okay in terms of engagement i will look at number of sellers and shops do we have enough shops number of active sellers per week number of active buyers uh how many items are being purchased how many items are being sold and then about the gross merchandise value of items
i was going to ask if you can talk me through why some of those are important so typically when i look at bow seller and buy right i see a repeating pattern sometimes so i can see that hey item being purchased and sold i think i see a strong pattern over here and and like we discussed i think this is the point of true value when your items are being sold and when items are being purchased that means your product is giving a good value to the ecosystem okay another great metric that i was thinking
about is the gmv of item gross merchandise value um say in case of marketplaces or in case of e-commerce it's not just important to have multiple transaction your volume of transaction also matters like say for example am i selling greeting cards or 50 cents and i'm selling the lot but i'm selling out rings or i'm selling out furniture of higher value the reason being when higher value goods move i think in future it would be great for facebook because that's how we will make money five percent on a transaction cost so higher the value of
transaction more revenue can facebook make in the future and that's basically the business model for all marketplaces or e-commerce platform you make money out of processing also it means that users are trusting facebook with high value items um then we look at the retention part it's the repeat sellers and repeat buyers i think i think a typical what we can do here is 30-day 60-day retention for the typical retention metrics we can look at that of of all the seller that activated in the first month in 30 days or 60 days how many of them
still have an active shop and then we can look at repeat buyers of all the buyers who purchase something in the first month how many of them keep coming back to the shops what also a lot of e-commerce platform faces sellers tend to get sales in the first month they start with marketing but eventually the sales don't happen and the shops become just stagnant so it's important to track us your how many of the sellers are able to retain on a month by month basis okay yeah cool and then you know in the interest of
time i haven't gone deep dive into it but i think few things i could see that could fail was your catalog failure your catalogs on catalogs are not updating your shop is not being listed uh there are redirect failures there are purchase failure and buyer all these things that can hinder the experience of seller or buyer we just choose a couple of metrics and put them as a quality metric it's more for the engineering to track and more for pms to track in the sense that hey our experience and everything is working fine this is
more critical for new products like facebook shop compared to legacy products then let's talk about our not star metric downstream and counter metrics um basically i would lean towards number of items sold per week but the issue is i cannot actually calculate how many items are sold because like we discussed checkout actually happens on the on the website of the sellers in most cases i'm thinking are there any proxy metrics that i can look at like and again i don't know the integration but then facebook shop does have integration with shopify big commerce and all
these platforms and then inventory might be in sync so if an item is sold on their platform and inventory account reduces we may know that our item has been sold we can also look at referral data refer referral data like with the utm param the flow on shopify came from facebook so you can know it by the referral like who the referrer was and then you can attribute those sales to facebook but again all these don't tend to be very accurate like i can kind of get a directional data from it but that's not something
that i will be able to 100 rely on even in the case of an inventory count was reduced it would be very difficult to tell whether that sale happened because of a redirect from facebook shop or that sale happened because of an organic traffic on the main website and again not every website on facebook may be integrated with these platforms right so actually the smaller businesses you can imagine exactly exactly so what i need to do now is maybe look at a proxy data if i look into the funnel i think one step just before
the sale happen is basically clicking on that call to action that takes me to a different website so probably i can i can say a number of purchase and 10 clicks probably yeah i think this is something i can just mark as my not start metric let me quickly validate if it's a good not star metric or not like say if i were the pm for it running facebook shop in order to improve this number improve the number of purchase intent click a good way to do that would be uh actually to increase number of
shops if my number of shops are increased that means uh i'll have more surfaces where people can go ahead and click on that what is the function of improving the number of shops basically number of sellers another way could be number of items another factor that can help me increase the number of clicks can be the number of buyers number of repeat visit from buyers so i can also think of like hey if i were to build up an org around facebook shop i can have one seller division they can focus on increasing the more
number of sellers increasing number of shops increasing number of items that give diversity i can have a buyer org that can focus on bringing more buyers ensuring that buyers come and have more repeat with it one thing i would be worried about for number of purchase and 10 clicks like you mentioned it is pretty far from the actual action that drives value either in the future or what are ways we can maybe find things that get closer to the ground truth although logically the funnel it's one step below the purchase happen but multiple things can
happen like people may drop up on the side and it may not be a true indicator of that but it can be more of a directional indicator like i said and again we'll have to rely on our partners in the beginning what we can draw is draw out a quick pattern of it like it takes 100 clicks on fb shops to convert into one person our conversion rate is one percent okay once you have your conversion rate baseline set it can be a good leading indicator of number of sales happening okay and once these metrics
and baseline gets pretty much defined it kind of remain constant unless your partners are improving their website which will be very difficult to make a meaningful change because your risk is spread out over multiple partners in the future when facebook starts giving out a native checkout experience to all the users and everyone adopts that it would be very simple to measure how many sales is happening why might it be important for facebook to really heavily invest in getting closer to the ground truth the risk with proxies is it might give you an impression that hey
we are doing well our clicks are increasing every day and everyone will be celebrating but in reality maybe after your click the redirect doesn't happen there's a 404 or 5 some hyperlinks will be broken and your buyers are not able to reach the website or the website you're redirecting to their website is so bad that buyers are not able to buy if buyers are not able to buy they won't basically say that hey it's because the site is bad in their mind they started their journey on every shop they will start losing trust in that
bishop if buyers don't convert or buy sellers don't make a sale sellers would say hey it really doesn't add any value to be on fb shop so everyone will start losing the value that our platform promises the value we promised to sellers is hey we'll get you sales through our organic channel the value we promised to our buyers is we'll be able to showcase your different products that you can really cherish and enjoy yeah but if that doesn't happen uh people will stop driving value out of it let's look at downstream metrics because we have
launched facebook shop what other impact it might have on the facebook ecosystem uh number one thing is would love to track his engagement on news feed now because people are spending time on facebook shop and it's redirecting user to a different store outside is the engagement on newsfeed uh damping like is the total engagement that they have on fb is it going up going down or staying flat marketplace interaction although facebook shop is different from marketplace they sort of do similar thing there is a good overlap between them what we want to track is there
is no marketplace cannibalization the buyers that we're trying to buy on marketplace they're now coming on every shop spending time there and maybe our marketplace have gone down marketplace sales have gone down and maybe we can track ad revenue as well um because advertisers are poor part of the whole thing uh maybe people were earlier buying different products from the ads they see on facebook newsfeed but now that we have introduced facebook shop their mental idea of buying certain things goes to fb shops and our ad revenue of independent products on news feed is being
impacted these guardrail metric just help us understand that hey we are not cheating or not style metrics uh or we are not trying to gain something at expense of something else things we can track is number of listings taken down because we might we are so hell-bent on improving our nostalgia metrics we just open the floodgates to everyone we don't we compromise on our risk models and it ends up getting a lot of listings which are actually bad uh or fake and those listings are taken down number of disputes i don't know if facebook has
a dispute mechanism but i think one thing you want to know is buyers buying something through facebook shop receive terms or having a bad interaction and they may be calling our customer support uh so we should record those complaints that's happening and number of shops close because certain shops uh had such a bad behavior of such a moving behavior they had to be closed down i had one last call question and it's a semi-trade-off question this should be quick we talked about gmv and you mentioned there's a trade-off between low margin items and high margin
items so on the low margin items you'll get higher volume so more transactions and the lower margin the higher margin items you'll get less transactions and more total gender which type of sellers would we try to onboard more a good way to solve these things or these decisions is to look at the unifying metric our number of a unifying metric is number of percentage intent click if i were to scientifically make a guess that hey should i do a versus b like should i go with low margin or high margin items i'll probably run a
very controlled experiment uh of course taking out the marketplace effect and novelty aside run a very controlled experiment and look at with the low margin items versus high margin items where am i getting more number of sales on that would also give me an idea where do people perceive us to be in the player like some marketplaces if i'll call to say the name like say bonanza or the others or wish.com wish.com is pretty much popular for low value items right that's the niche or the brand they have established where certain items certain marketplaces tend
to sell more of a high value item is known we really don't know where facebook is positioned it may be a strategic decision where we want to place ourselves but a good way to check is scientifically through the data where do customers perceive us where do we stand in the eyes of the customers all right let's debrief self-reflection let me start from the top i think we covered fb mission shop intro target stakeholders business school i think that part went very solid what i could have done is be more cognizant of time and uh then
based on that we came to our north star metrics we justified a non-star metrics one thing i should have done better is proactively called out the risk this metric is not perfect but you have to ask me that question of the risk where i should have proactively answered you know why it's a risk risky metric and how we will deal with symmetric so let me structure this from the start to maybe the end the first part i think really really stood out it was strong start strategic thinking so here i have written down you called
out advantages differentiation between one product and the other we call that that we have the lack of sight of the full funnel and just the knowledge of the product i was really impressed by that again for these facebook interviews the interviewer does not expect you to be an expert at the product but you seem like you knew it like the back of your hand i think to your point you were exhausted which was good um but like you said managing time here could be a trade-off another thing i wanted to call out early on it
could be helpful to share the structure of the approach early on with the interviewer to make sure that you don't miss anything so here i always say best practice is kind of share your agenda point because there is where you can align on oh you actually can save yourself some work and don't need to cover some people don't care about downstream metrics i think overall i wrote here the communication and structure was just very easy to follow so the second part was going through the metrics what stood out and something i know i tell all
of you guys is sharing the why for the metric and here i think abhishek did a good job of proactively sharing you call that the metric the number of shops that have one item sold and he said it was because that's when they find value so he explained why he intentionally chose that metric one thing he kept doing throughout was calling out the value to users so you saw when he highlighted his northstar metric or what was in red number of items sold at that point kept saying this is when the buyer and the seller
gets their value i think like you called out the trade-off bit i like that you call it the unifying metric but if i think about it the unify metric is going to bias towards the number of transactions because the item of so the number of items sold the step before that is the number of clicks so that is going to prioritize the higher transactions and maybe come up with another metric or kind of make like you said the strategic decision to say early on we want as much engagement as possible so even if it's low
margin we want people to get into the practice of buying on facebook and then later on vary it up with onboarding higher value items step by step i think this was guys a really good model example of hitting all the right notes on being strategic and explaining why the metrics versus just listing a bunch of metrics which most candidates do and there if you just list metrics that's not going to help you stand out because there's only so many metrics you can cover for products and hence anyone coming in to answer this question is mostly
going to say the same thing and i want to end it off object because you did such a great job what is your one two secret tips what really helped me was to be aware of different products in the market and to understand different business model if you go out in the market you see there are actually like you know top five or ten different business model that work try to understand them in depth every question is actually a variation of one or the other thing so if you understand those business models in depth you'll
be able to answer any metric question the other thing that really helped me is always ask yourself what the value is and i think diane does that very well in her youtube videos uh you can come up with tons of metrics but always ask yourself where does the real value lie and try to hit that crux that will really help you stand out from the other candidates one common question i get on your first bit where do you go for sources to learn about the different business models products etc well i actually just googled it
um and was very again as pm's i think we are inherently very curious so if a new product launch i'll be very curious because i worked in e-commerce space when facebook shop launched i was very curious the reason i was able to go in depth is because i knew about facebook shop i was very curious about it other advice is never go into a company interview without understanding what the company does again in-depth knowledge is not needed but if you really know about what they do that really helps i'll give you my example what i
did uh i don't recommend you do that in depth but i went through the earning calls of meta i really looked at what was the earning call what really happened what's the key strategic outlook that mark zuckerberg said uh when the dau started dropping in how would the company change your pivot why that drop happened see all these nudges when you bring in the interview would always present you as a very strategic person stay curious stay hungry is that what job said is that right now you stay foolish i guess okay not even close okay
well thank you guys so much and thank you to abhishek for being a stellar mock interviewee