{"id":24385,"date":"2021-09-05T13:39:51","date_gmt":"2021-09-05T20:39:51","guid":{"rendered":"https:\/\/www.podfeet.com\/blog\/?p=24385"},"modified":"2021-09-05T15:01:49","modified_gmt":"2021-09-05T22:01:49","slug":"apple-apps-location-spotlight","status":"publish","type":"post","link":"https:\/\/www.podfeet.com\/blog\/2021\/09\/apple-apps-location-spotlight\/","title":{"rendered":"Apple Apps Aren\u2019t In Your Normal Applications Folder and Why You Might Care"},"content":{"rendered":"
\"Applications
Applications Folder Shows Apple Apps<\/figcaption><\/figure>\n

Did you know that Apple apps aren\u2019t REALLY in your top-level Applications folder with all of your other apps?<\/p>\n

If you open your Applications folder on your Mac using the Finder, you\u2019ll see all of your Apple apps intermingled with your third-party apps, but it turns out they\u2019re not really there!<\/p>\n

To prove what I\u2019m saying, we need to view files from the command line using the Terminal app. If you haven\u2019t used the Terminal before, don\u2019t be afraid as this will be very easy, I promise. Terminal is inside the Utilities folder inside your Applications folder.<\/p>\n

We\u2019re going to change directory in Terminal to your \u201cnormal\u201d Applications folder. The command cd<\/code> is short for change directory. Open Terminal, and simply type :<\/p>\n

cd \/Applications<\/code><\/p>\n

Now let’s list the files in this folder using the ls<\/code> command:<\/p>\n

ls<\/code><\/p>\n

If you compare this list to the Finder view of your Applications folder, you\u2019ll see all of your third-party applications, but you won\u2019t find any of your Apple apps listed.<\/p>\n

\"Main
Where is the App Store? Where are Automator and Books?<\/figcaption><\/figure>\n

You may have noticed that your Mac has another Applications folder under System. Let\u2019s change directory using our cd<\/code> command to the System-level Applications folder.<\/p>\n

cd \/System\/Applications\u00a0<\/code><\/p>\n

Followed by:<\/p>\n

ls<\/code><\/p>\n

Well looky there, all of your Apple apps are in the System-level Applications folder!<\/p>\n

\"Apple
Here They Are – They’re Hiding in \/System\/Applications<\/figcaption><\/figure>\n

Isn\u2019t that curious? I noticed this a long time ago and I thought about doing a writeup calling this \u201cFun Facts to Know and Tell\u201d, but recently I had an experience where knowing this gave me a clue to a problem I was having.<\/p>\n

Why This Might Matter<\/h2>\n
\"Drag
Drag Drives Into Spotlight Privacy to Stop Indexing<\/figcaption><\/figure>\n

The problem I’ve been having is that Spotlight keeps forgetting where my apps are. I launch Spotlight and type in Mail, and it shows me things like the Gmail app in the Mac App Store, instead of finding Mail on my drive. When this is happening, I also notice that Spotlight is indexing my drive. After a while it finishes and then I can launch apps again via Spotlight but then a few hours later it stops finding them and starts indexing again.<\/p>\n

Luckily, there’s an easy trick to force a reindex, which I hoped would unconfuse Spotlight. The easiest way is to do it through the Spotlight System Preferences pane. In there\u2019s a tab for Privacy. This is where you put volumes or folders you don\u2019t want to be indexed by Spotlight. A good thing to put in there is your connected backup drive, so you don\u2019t start accidentally opening things via Spotlight in your backup.<\/p>\n

If you want to force Spotlight to reindex your drive, you simply drag your main drive into the Privacy tab for Spotlight which will stop the indexing. Close System Preferences, reopen it, and take the drive back out which will cause Spotlight to reindex the drive.<\/p>\n

Unfortunately for me, this didn’t shake loose whatever was wrong, because my Mac continues to forget where the apps are, reindex on its own, find them, and then forget again.<\/p>\n

Call for Help<\/h3>\n
\"Man
man Page for the `mdutil` Command – *s for the Commands We’ll Use<\/figcaption><\/figure>\n

I didn’t have any other ideas, so I wrote to the Mac Geek Gab, and John F Braun suggested using sudo mdutil -E \/<\/code> from the command line. In the terminal, you can view the manual for most commands, by typing in the word man<\/code> followed by the command. Anything with a dash in front of it is called a flag, and these are described in a list within the manual. I typed in man mdutil<\/code> and the manual told me:<\/p>\n

” mdutil — manage the metadata stores used by Spotlight”<\/p>\n

Fair enough, now what does the flag -E<\/code> tell the mdutil<\/code> command? The man page says:<\/p>\n

“-E This flag will cause each local store for the volumes indicated to be erased. The stores will be rebuilt if appropriate.”<\/p>\n

This sounded dandy except for the “rebuilt if appropriate” part. I want it _definitely rebuilt, but what the heck, I ran the command.<\/p>\n

Just like with dragging my disk into the privacy pane, the mdutil<\/code> command worked for a day or so and then the problem came back. I booted into Safe Mode to try to clear things out, but the problem came back. Why not try an SMC reset? It seemed to fix the problem too, but the problem came back. I then realized that simply rebooting fixes it temporarily.<\/p>\n

I tested in other accounts on my system, and the problem wasn\u2019t there, but since I can\u2019t really work in those accounts for very long because my stuff isn\u2019t there, I don\u2019t think I really proved whether it was working or not.<\/p>\n

And Then a Clue Arrived<\/h2>\n

After literally weeks of this problem, I got a new clue to the root cause. I noticed that it wasn\u2019t all apps that wouldn\u2019t launch when the problem was occurring, it was only<\/em> the Apple-specific apps.<\/p>\n

Since we know that the Apple apps are not in the \/Applications folder and instead they live in \/System\/Applications, what if the permissions were borked on the Apple Applications folder? I looked at them using the Terminal (that’s kind of an advanced topic so I won’t go into it here) and I didn’t see anything wrong. So now I have this great clue, but what do I do with this information?<\/p>\n

Reinstall macOS<\/h2>\n
\"macOS
macOS Recovery Mode Reinstall<\/figcaption><\/figure>\n

Around this time, I had a whole new problem on my Mac. The new entertainment was that when I used the caps lock key, my Mac would pause for up to two full seconds before continuing to finish what I\u2019d typed. The pause was so long that often the words I typed after the caps word came out before<\/em> the capitalized word. I know, many of you are yelling into your devices that the caps lock key is evil and I should disable it, but I learned to touch-type when I was a young child from my mother’s 1946 typing school book, and if it was good enough for the Podmom, it’s good enough for me.<\/p>\n

While that was supremely annoying, I then realized that autocorrect caused the same 1-2 second lag. I may be a touch typist, but autocorrect is still my friend and now it was betraying me too. Then things really got bad because TextExpander snippet expansion was also plagued with the interminable lag. THAT<\/em> was unacceptable, and it was time for drastic action.<\/p>\n

My friend and Apple consultant Pat Dengler suggested it might be time for an over-the-top reinstall of the operating system. This is not a nuke and pave, it’s actually a very simple and quick way to replace the OS without any other bother. Think of it like lifting everything in your house up in the air, putting in new, but identical carpeting minus the stains you had, and then setting the furniture back down.<\/p>\n

This sounds like a terrifying task, but it’s actually really easy and doesn’t take very much time. You simply boot into recovery mode, run the reinstall and it takes maybe an hour or so. Of course, don’t do this without a full backup, but in my experience, it hasn\u2019t been destructive and only fixes things.<\/p>\n

After the reinstall, not only did the SUPER annoying pauses go away, to my delight, Spotlight started doing its job properly.<\/p>\n

Until it forgot all about the Apple apps and started reindexing again.<\/p>\n

AppleCare Phone Call of Sadness<\/h2>\n
\"Applecare
<\/figcaption><\/figure>\n

It was time for the most drastic of solutions. I knew I had to call AppleCare. But I didn’t want to. I’m soooo tired of calling them. I’m never happy afterwards.<\/p>\n

I procrastinated for a few weeks successfully only because of something I heard on the Mac Geek Gab. I didn’t realize that you can use Launchpad to launch apps just like you can with Spotlight. Yeah, I hear how dumb I sound not realizing that something called “Launchpad” can launch apps. But I didn’t know it could be invoked with Control-Space. That means it’s just as easy as Spotlight, and all I have to do is retrain more than a decade of muscle memory. Interestingly enough, Launchpad can always<\/em> find my Apple apps when Spotlight has amnesia.<\/p>\n

It still bugged me that Spotlight was so broken for me, so I finally broke down and called Apple. I told Sam, the first-level tech that there was a 90% chance he’d have to send me up to a senior tech, and then described pretty quickly the problem and everything I’d tried. Sam immediately said, “Yep, you’re going to a senior tech.” Lovely that Sam did it quickly. Many times first-level techs have been amazing for me, but I was pretty sure this was going to be a tough one.<\/p>\n

Sam handed me off to Nicole, and she has been lovely as well. She quickly read Sam’s notes, we chatted a bit and she said, yeah, you’ve done everything I would have told you to do. Off to engineering for you.<\/p>\n

We all know that “off to engineering” is a euphemism for “wishing you into the cornfields” from that awesome episode of The Twilight Zone with Billy Mumy<\/a>. It’s where tech problems go to die.<\/p>\n

But in a crazy twist of events, engineering actually responded quite quickly. They sent a message back to Nicole to relay to me. They suggested something similar to John F. Braun’s command line method but with a few more steps.<\/p>\n

\n Please have the customer open Terminal and run the following command:<\/p>\n

sudo launchctl load -w \/System\/Library\/LaunchDaemons\/com.apple.metadata.mds.plist\n<\/p><\/blockquote>\n

Off to the man page for launchctl<\/code> only to find the explanation “Interfaces with launchd”. Ok, what’s launchd<\/code>? Man page says “System wide and per-user daemon\/agent manager”. That didn’t have a lot of meaning for me, so I dutifully ran the command.<\/p>\n

I got the response that the service in the command was already loaded so I guess I didn’t need to do that step. The engineer’s next directions were to restart, make sure Time Machine isn’t running. Then they told me to run almost the exact same command John F. Braun suggested. This time they put the sudo<\/code> command in front. sudo<\/code> means ‘Super User Do” which escalates your privileges for the upcoming command.<\/p>\n

sudo mdutil -Eai off\nsudo mdutil -Eai on\n<\/code><\/pre>\n
This is interesting, we used mdutil -E<\/code> last time to cause each local store to be erased and rebuilt (if appropriate).  According to the man pages for mdutil<\/code>, the -a<\/code> means to apply the command to _all_stores on the volume, and -i<\/code> allows you to add the on and off commands.<\/p>\n
They ended it with one last mdutil<\/code> command:<\/p>\n
\n  mdutil -as<\/code>\n<\/p><\/blockquote>\n
The -s<\/code> flag tells mdutil<\/code> to show the status of indexing by volume on the system.  When I ran the status command right after doing the turn it off and back on again dance with mdutil<\/code>, it showed me each of my volumes and said “indexing enabled” next to them, with the exception of my backup drive which said disabled instead.  That makes sense since I’ve purposely excluded it with the System Preferences pane trick.<\/p>\n
But later, when the system starts failing to find Apple apps again, I ran the status flag on mdutil<\/code> again, and now it says that it’s disabled<\/em>.  I’m not sure if that’s a clue or not but I’ve sent it off to engineering.<\/p>\n
\"Indexing
Left: Indexing enabled when Spotlight is working, Right: Indexing disabled when Spotlight is confused<\/br> Note: my backup drive was attached in the left screenshot<\/figcaption><\/figure>\n
\"Run
Run Spotlight Diagnostics from Activity Monitor<\/figcaption><\/figure>\n
The final instructions from engineering were to make sure to not launch any third-party apps until the indexing was done (which was very annoying) and to not run Time Machine either.  Finally, when all was working again, they asked me to run a diagnostic on Spotlight.<\/p>\n
If you open Activity Monitor from your Utilities folder inside Applications (or using Spotlight if yours is functioning properly), there’s a little circle with three dots icon that when selected will let you run a Spindump, System Diagnostics, or Spotlight Diagnostics.<\/p>\n
It took a while to run, and created a huge<\/em> bundle of text files, so there was no chance I’d be able to read and interpret it, but it’s cool that they have something to look at.  I decided to run this diagnosis when Spotlight was misbehaving since it seemed uninteresting to give them when it was<\/em> working.<\/p>\n
Now I’m at the twiddle my thumbs again and wait stage, but at least I have the impression that they’re looking into it!<\/p>\n
Another Instance Where Knowing This tip Was Helpful<\/h2>\n
This all started as a “fun fact to know and tell” about Apple’s apps only pretending they live in the normal Applications folder, but I actually ran into needing to know this tidbit a second time recently.  In Programming By Stealth, Bart was teaching us how to tell our Terminal what our preferred text editor is. You can tell it to use one of the nerdy command line editors like vi or nano, which feels natural to me, or you can have a GUI app like TextEdit pop up when you ask to edit a file in the command line.<\/p>\n
In my configuration dot file, I dutifully told it to point to an app I like called CotEditor, and it worked perfectly. But then I tried changing it to TextEdit, and asking to edit from the command line did NOT open TextEdit.  That’s when I realized that since I was working at the command line, I was typing the full path to the app, and TextEdit is not in \/Applications, it’s in \/System\/Applications!<\/p>\n
See? I told you this was a handy thing to remember.<\/p>\n
Bottom Line<\/h2>\n
The bottom line is that I think that knowing your Apple apps aren’t really in the “normal” Applications folder is not only a fun fact to know and tell, it might also be a good piece of information to tuck away in the back of your brain just in case things get weird for you.<\/p>\n
Also, I’ll let you know if Engineering from Apple ever lets me come back in from the cornfields so I can use Spotlight reliably ever again.<\/p>\n","protected":false},"excerpt":{"rendered":"
Applications Folder Shows Apple Apps Did you know that Apple apps aren\u2019t REALLY in your top-level Applications folder with all of your other apps? If you open your Applications folder on your Mac using the Finder, you\u2019ll see all of your Apple apps intermingled with your third-party apps, but it turns out they\u2019re not really […]<\/p>\n","protected":false},"author":1,"featured_media":24376,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[147],"tags":[4778,459,230,572,4779,3226,229],"class_list":["post-24385","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog-posts","tag-apple-apps","tag-applecare","tag-command-line","tag-diagnostics","tag-mdutil","tag-spotlight","tag-terminal"],"jetpack_featured_media_url":"https:\/\/www.podfeet.com\/blog\/wp-content\/uploads\/2021\/09\/Apple-Apps-in-System-Applications.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.podfeet.com\/blog\/wp-json\/wp\/v2\/posts\/24385","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.podfeet.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.podfeet.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.podfeet.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.podfeet.com\/blog\/wp-json\/wp\/v2\/comments?post=24385"}],"version-history":[{"count":4,"href":"https:\/\/www.podfeet.com\/blog\/wp-json\/wp\/v2\/posts\/24385\/revisions"}],"predecessor-version":[{"id":24390,"href":"https:\/\/www.podfeet.com\/blog\/wp-json\/wp\/v2\/posts\/24385\/revisions\/24390"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.podfeet.com\/blog\/wp-json\/wp\/v2\/media\/24376"}],"wp:attachment":[{"href":"https:\/\/www.podfeet.com\/blog\/wp-json\/wp\/v2\/media?parent=24385"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.podfeet.com\/blog\/wp-json\/wp\/v2\/categories?post=24385"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.podfeet.com\/blog\/wp-json\/wp\/v2\/tags?post=24385"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}