I am surprised that no one has really brought up that Fram oil filters are basically
CRAP! 
Check out this guys page where he takes all sorts of brands of oil filters apart to see what they are made of and their quality - Frams were the worst of the worst. They have the least amount of filter surface and the caps on both ends were made out of
cardboard. That's why I immediately thought of this article because that stuff you took out of your pan looks like cardboard and/or filter fibers to me (along with the metal bits).
I know the filter is not the spin on type, like the ones this guy takes apart, but I bet the quality is still crappy. Wix filters are
really well made, come with all the replacement rubber o-rings, and cost me only like $7.00 so seems silly to cheapen out and go for a Fram?
http://www.lesabret.com/filters/filter.html
"The Fram uses a decent material, but it is arranged unevenly between the cardboard end caps, which are actually thinner than the filter element. Since the valve doesn't hold the element in place, they use an octagon shaped end cap, which allows the oil to flow through between the flat section and the round canister. This doesn't leave a lot of room for the oil to flow around the end cap, and puts more stress on the cardboard. The Fram had the least filter area by a wide margin. It was also the thickest, but it was very fragile. Removing a portion of material for measurement totally destroyed the filter cartridge since the end caps and center tube are not attached. This made it very difficult to test, and showed another downside to the cardboard end caps, which are evidently very flexible."

"The inner tube is metal, but has very few holes for oil to pass through, possibly restricting flow. It is also not held in place at all, and moves around easily."

"The base plate is a thick material and has lots of threads. The holes drilled into it are numerous, but small, so their ability to flow is probably on the low side. The gasket is thin both in thickness and height, and crimped on with light indents in five places."

"The anti-drain back valve is cheap, and very thin. It fits loosly into the cardboard end cap. I'm not sure how, if at all this seals."
ALSO RELEVANT:
"I have taken apart several used filters, in an effort to find failure. A design may look bad. but may never have any problems. Or it may look flawless, but fail in use. So far the only failure I've found is from this Fram PH3387A. This does not mean that all Fram filters will fail, but does back up some of my observations."

"This filter element has seen better days. The cardboard end caps are actually intact, but the filter element has been severely damaged."

"As you can clearly see, the filter has a hole in it. This is probably caused by the oil pressure actually pushing the filter right through a hole in the inner tube. "

"Here's the most disturbing part. The anti-drain back valve has actually folded over, allowing the oil to completely bypass the filter element. The Fram's thin valve and poor design is the most likely cause. Unlike most of the other filters, there is not a metal end cap to support the valve. Another thing to note is that the valve was rock hard, obviously affected by the dirty oil. This suggest that a Silicone ADBV is a better idea. "